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During 1982-83, the bilingual studies program at East 
Texas State University (ET5U) continued to improve at all levels, but 
especially at the undeii^raduate level in its attempt to produce 
highly qualified bilingual and English as a Second Language (ESL) 
teachers and specialists. Funded by ETSU, the^U.S. Dejpartment of 
Education, and the Texas Education Agency, the 7-year-old project 
began in cooperation with the Dallas Independent School District but 
expanded to other schools. During the year, the program cooperated 
closely with other universities, educational service centers, the 
Texas Education Agency, and other ETiSU departments. Both observers 
and students rated degree and endorsement/certificate plans and 
instruction highly. Graduate courses and courses in Spanish and 
methods received the highest ratings* Some undergraduate courses 
caused problems but only six received low ratings. Overall, the 
program showed improvements in instruction and degree design. 
Preliminary results 6f a survey* of former students indicated they 
felt the program was strong, especially the Spanish, methods, ESL, 
and social studies courses. Their negative remarks were consistent 
with current , student opinion. Appendices include, the revised program 
of study, evaluation forms, and the survey. (SB) 
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ACmWLEICMENrS 

The external evalxiation of the Ea^t Texas State University ESEA Title VII Bilin- 
gual Education Program necessarily entailed the collection of a great many data. 
Maijiy liiiversity professors and administrators, teachers and admiiiistxators from 
participating school districts, and the participants in the program prpvided 
information and statistical data. While the nuniber of those assisting is t&o 
large to name them all,, tiieir help is sincerely appreciated. 

Mach of the burden of coordinating the collection of data and arranging for the 
moriitoring of thl[ wDrk ^was borne by : ' 
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Alonzo Sosa, Bilingual Studies 6x)rdinator. 



His efforts on behalf of ,the study aire deeply appreciated. The facilitation^ 
of the interviews and other data collection made the study possible. ' 

.' " . . - • ■ ■ . - 

In addition, much of the detail work on the student fol^Lcwup survey "was ccnduc- . 
ted by Mrs. Qlga Perez; her persistence and efforts are -appreciated. . 

The Bilingual Education Advisory Committee,, an inportant -facet of the management 
ot the program, was generous in giving of time and information to help, facili- 
tate the evaluation. Special thafiks go to the members of that comnittee. 



mJU mJL. 



This report was prepared u^der jcontract with East Texas State University through 
ESEA Title VII finding. Grant 605248, from the. US Departnfint of Education. Of- 
ficials of East Texas State liiiversity and the participating districts assisted 
by providing or facilitating information. The data reported, however, and the 
conclusions drawn, do not 'necessarily represent the official positions of the 
(^tricts, the IMversity, ,or the US Department of Edqcation". No official 
endorsement idf^"Shem should be inferlrfed. • ^ ■ 
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TH£ EAST TEXAS STATE UNIVERSITY" PHDGRAM 



East Texas State University, in conjunction witW tjie Dallas Indepen- 
dent School District and others in the North Texas'area, .and with- 
funds from the US Department of Education and- s^me especially desig- 
nated monies' .from the Texas Education Agency, plus budgeted items 
from the Univfersity itself, established a bilingual studies program ser 
yen years ago aiTd has operated it since that time.. ,The pr«iijiary pur- 
pose of this training program is to assist the/ State through the 
provision of wel]. prepared -t-eachers , administratprs , and* specialists! 
to tipgrade the teaching/of Texas bilingual students. - ^ \ 

During -the past Several years , enormous gains/ have Been .registered ^ 
in the provision/ of ■ services to limited and npn-Engliah speaking pu-. 
pils. . Some students still'dp not receive the necessary- services , . 
however, because the shortage of c|j|^lifie\i teachers still .persi'Sts . 
Indeed, the statistics on the la'tt^^ problem' i an ..insufficiency: nxm^ 
hex of teachers, have riot chan'ged- in recent /years due in part to • 
*'the increases in ''the number of youngsters needing -bilingual (sduca- 
.tion and in .par-t tb the number of teachers that have left the'. pro- 
fession each ye^'ar or who take jobs in-other^ staters. . 

The State of Texas "lias a high proportion of ^Mexican Americans , ' other 
Spanish; speaking' populations , Native Americans , 'and recently, speak- 
. ers 9f .0t.ner languages , 'notably Vietnamese.. ^Too," the emphasis on *, 
teaching English as'';a^. Second Language, both as a s.eparate subject' 
and in conjunction .with bilingual, education , increased, the training / 
\tieeds "for the INorth Texas area/J The original anticipation, then, of 
.a relatively short .term trainipg ef f ort , was V-hot borne out. While 
V the ..number bf Mexican 'An^^ enrolledVin univefsitdes has' risen 

dramat^ically in Texas , the number training to be bilingual education 
teachers leveled, off before the needs were met. Nearly /ho. Vie.tnamese 
speakers, kre 'ierirolled in teacher training programs in the ■ State and ' 
few from other language groups' expect to enter the field. 

, ■ ■• ; ' ; / / ■ ■■ - . " ^ \ ' ^ ■ ■ •'■ 

Several factors 'have contributed . to the slow growth invt^^ number* of 
Spanish speaki£hg teachers. - Although .most Mexican 'Americans are flu- 

'ent in oral/aural Spanish, few of the older teachers «and only recent- 

' ly some o'f the younger people, have ]iad the opportunity to become 
fully literate iti*that language-. Many high schools and most unlver.- 
sitxes of fered "Spanish^ courses but sihce thext thrusf w^s. conversa- 
tiop-, few Mexican Americans enrolled.- This lack' reduced the pool of 

\potential teachers 'from that group. Fuifthermor'e , as- with ,^11 groups; 
cnly a limited, number want to be teachers - they enroll in *m^ny dif-:. 
f^rent academic programs. Too,; even those 'who choose education as a- 
career, .do not ^^necessarily w^nt to teach i,n elementary schools nor 

, InvbLlirigual education; many prefer to teach mathematics, 'science, 
and th^ other fields. As with s^peakers of any other language, in- 
dividual inclinations varj^ widely. 

Additionally, the .salaries of teachers in Texas hive not kept pace 
with' those in many other fields and education's dr^awing power among^ - 
.Mexican Americans has decreased. Highef^alaries elsewhere drain 
Texas resources. ^And, finally, there is^ Aubstantial* proportion 
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6f. Mexican Araer/icans that has not subscribed- ^o 'bil^gual 'educate 
as' a way tp inipirove the education of their children,. \That j /al^so/ 
-yreduces the potential f of' Spani.sjt/Engli^h bilingual eduction as/a 
cl).os en -teaching field. . ^ ' ■ • ' . ^ v . ' ' 

The East Texas -State Universl^ty ESEA Title. VII 'Bilingual Eduqgition. 
Program is a vi.tal part ,of . the necessary /mobilization to. meet' the- 
challenge.- By. providing not, <5jily the stibj ect matter *and educatiojti 
courses required^, .but -additionally offering a "s^trbng • program in \he 
' sWanish language the University help^ those ^Iready^ literate in 
tne lang*iFge, those who 'need only certain pprti^Yis of it*; or -thbse 
who want toobeccme fluent and literate, /Further, .with the popula*-^ ' 
* t/ion^ of Spanish speakers growing in the nortn^rn portion oi the 
ftate, and with the econpmic status- of many ^ qf^t^jem ^till low in , 
:orapar.ison tq^ some other gr6ups, the'tuition assistance part of « 
:he' program ' has not diminished in importance. While. Texas' t'^b^chpr 
/salaries may not be very high^that field^AStill serves as one ave- 
/nue'for upward mobility' while at the 'same time pr-'dyid^ng t.eac^Hers 
who can be trained\^'or bil ingual , education duties and who, -at j the 
same time/, understand the needs of the youngsters they sferve. The 
earlier -federal » aioi, of furnishing seed monies for the establishment 
of university programs wias commendable and has produced important 
results.; The 'adidit ional benefit , helping suprply 'the training of 
bilingual t^aChex$ while at the same ' time assisting low income Mexi- • 
caji Americas and others to enter the education field, should not 
yet be abandoned. The heed is sfill great; The continuing partici-' 
patiqn df 'the federal and 's^ate gqyernments , the school districts, 
and the University is vital, to improvements in education. 
■ ' '"' ■ 

■ -. . ■ * . " ^ ■ ' ' » 

" » ' Program Ol>j ectives . T 

The, program at East Texas State University, was d'esigned to increase 
t,be ef ^ecJcivdness of teajchers and administrators in meeting ^he . • 
needs of limited and nonl-English speaking pupils in -the state, and 
especially in the northern 'part of the.state. The programs '^at all 
three levels undergraduate , masters , and doctorate - first offer i 
a strong* preparatory program in the. Several kinds of subject matte?"^ 
to be tauglit, in. the meth(5ds r8r general education, in the specific 
methods for bilingual education, and in linguist ics -and the Spanish 
language. That is, the-UniverSity is concerned tbat the* partici- 
pants, for example,, know mathematics and how to teach .mathematics 
in both English ajid Spanish.* Bilingual and multicultural skills in . 
counseling, administration, and other specializations are included. 
Expertise in working with parents and other community members of 
different Cultures' is an important part of the program. • 



Further, t.'he program was designed to Kelj!) educational personnel meet 
the educational needs and other^life skills of all childrenjj to de- 
velop the special expertise to provide equal opportunity ^ of access 
to children of limited and non-English speaking, proficiency, and to 
help improve their •performance* within • the educational, social, and 
economic systems once they have, gained entryj As a part of their 
education, the part^icipants also experience bilingual education as 

they pursue their undergraduate and graduate degrees, thus increasing 

"» ■ 

. * t 

* ' jr. " - 
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their awareness o£ the strengths and weakness©/, the promises and 
problems, of learning in two languages. The-«in:se5, the\bilingual 
environment, the utilization o£ the teachers ' classroom experiences 
in the program, and frequent meetings and other developiaeit^al work ' 
with prof essionals .in education and members of the communities, were 
expected to help -credte a climate conducive to. reaching th^* goals of 
this program. v. ^ 

The -program ot)jectives were stated in behavioral terms, that is, 
the program was designed as competency based, to help the students 
acquire the knowledge and skills needed ^in: \ 

. English and Spanish ^ \ • 

. Mexican American -and other pifltures 
. Bil ingual teachingjt methodologies ' 
. ' . Measurement of student progress 

. Research' methodology < \ 

Special objectives related to counseling, administration, and bther 
schoQl functions were also stated. In brief, the objectives s|)bke 
I to the acquisition', improvement, and knowledge of languages and! how 
•!. to impart them and subject matter to children; to add knowledge! of 
. the socioeconomic and'cultural realities of the US cultures, espe- * 
M. ipially Mexican American, and how these cai^ affect children's learn- 
ing; to increase teachers \ land o'ther personnel's knowledge and lup- 
;> plement their^ knowledge and skills in research so they can prof'iit 
if, more from publications^ and might, themselves , contribute to the pody 
'I of knowledge about Mexican Americans and^ bilingual education through 
■ research.* ^ 



^ ' , Program Processes ' 

East Texas State University incorporated a wide variety of academic 
resources into the program, utilizing the knowledge and expertise 
of many disciplines. English, Spanish, linguistics, history, socio- 
logy , anthropology , psychology, elementary education, and a<ibninistra 
tion were the sources of input, This necessitated the cooperation 
of three colleges and several de^)artmen:ts within the university , as 
well as the graduate division. The degree design 'and the. course syl- 
labi were carefully prepared with the advice of the bilingual educa- 
tion -pei^soniriel of the"^ Texas Education Agency, the Dallas Independent 
iS(jhool District and. others nearby, and representatives of the poten- 
tial students, as "well as* of -the communities they were to Serve. 
Further modifications -have been made as -each successive year's ex- 
periences wete evaluated. New courses, have been added as the need 
arose -and others have been modified. fSee the 1976-1977 through ' 
1931-1982. reports for the sequence of the changes.) 

N^any courses have been offered at the .school s ites from which the 
participants came, helping to increase the "^reality based nature of 
the program. Field experiences were also provided for students not 
currently teaching in bilingual education. Resource persons from 
the Mexican American community, both general citizens and, a number 



•555 originis^l appliaapion to the US Office- of Education dnd^the 
^continuation proposals to the DS department af Education^ 
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o£ professionals, were brought into the planning prodess 1 Ea^t T.vac 
suiting pool for the implementation of the D?ogr!^ Th^ Jk^— S"'' 



the bi- 



An essential ingredient in the plan was the participation ^f 

• ■ ■ * 1 

Liaison services were also included in the process' Facnitv w/th 
appointments that allowed monitoring of classes fn'wh^^r^ i^T- i 
education was being conducted, 4S's?ft?ng school s?af5s r'n^.n. 
ing with the student participants, vere'chosen af^L' ^r^mary pe^ o^- 

Additionally, the liaison pe?IoS ?a^h- 
ered information from the schools whibh was then* fed back^nto?h^ 

?f?ic?T;e!'"''' '^''"^ '-'^ "diversity in keepi^g't?self'c;?J:nt''Ld 



Sites for Instruction 



The campus of East Texas- State University with its lihr^v^ hii^- 
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for demonstrations and the maximum transferability to the students 
who are campus based/ While miost of'^fche campus courses for graduate 
students were taken during the sunim^r. sessions , some students were 
able .t<^ take evening courses at the University and increase their 
professional contacts. * • 

The. classes offered in the schools of the several districts have fa- 
'cilitated work with the community organizations , e^fecially those 
that were. Mexican American, since the studer^ts . werfe , in fact, in the 
community. ~ The arrangement also made it pos^iMe for a greater ex- 
change of information with bilingual education personnel, principals, 
and others interested in the teaching ^of limited and non-English 
speaking pupils. ^ ^ « • 

The East Te^ias State' University^ SatellitS^^earrv^ Center , with its 
expanded facilities for the library and for the staff, continued as 
an important resource for the faculty district personnel, and the 
students. The extension of the ERIC and Lockheed search terminals 
-to the center^ improved student and staff research capabilities. 

The problems of small school districts are often quite different 
from those as* large as : Dallas or Fort Worth. The inclusion of more ^ 
' of these in th.e program has materially aided the provision of tech- 
nical assistance to the districts, their bilingual and Engliah as a 
Second Language^^ programs , . and the general interaction between the 
faculty and staffs of the schools , - a mutually . belief icial communica- 
tions network for the districts and for the University. 
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APPROACHES TO THE EVALUATION- ^ • .. 

Three separate approaches w'eje utilized in the evaluation o£*the 
East Texas State University .'Title VII Bilingual Education Prograihi 
iaternal, external formative, and external summative. The first; 
internal, .had two- sources ' - the regular University evaluation acti^. 
vities . and/ the' monitoring of all work by the administratipii of th^ 
Title^ VII project. The second, formative by an external evaiuatot, 
was accomplished through a^n exrt interview and an ''interim' written re- 
port at the conclusion of each external hionif oring . , The third, sum- 
mative by an external evaluator, was |)rimarily composed of the pVe- 
sentation of the cjfata and conclusigns through the annual report. 

' • ■ " . ■ ■ ' ' ' . ', . ' 

^ ' Internal Evaluation , • 

East Texas State University 'maint4ined strict accounting of student 
enrollment, fiscal management, and faculty preparation for tg'achirig 
the courses..^ The: University was thus the most efficient source of . 
information on these areas and. it furnished reports on them to the 
funding source through its reguldr^hannels . ^ 

The supervisory functions of the deans of the- colleges and of the 
heads* of departments, add^d further dimensions to the management ^of 
the proje^. University wide committees' on curricula;, courses, and 
degrejis^-^ntributed to the development of quality -in the program. 
FacuLty committees* for the students seeking the undergraduate and 
graduate degrees , unique to each student or handled by an advisor, 
maintvained an .individual completion and quality control , - as well as 
contributing to the students development in the profession. The 
*cadeiAic Vice President was directly charged with the supervision of 
11 teaching/learning programs, thus involving the central admini- 



Ac 
a 

stration in the evaluation function. 



>^ Special advisory committees to the bilingual teaqher training project 
also were constituted*, includihg members from appropriate university 
entit\ies, the Dallas Independent School District , students, and fh'e* 
community. These committees' functiQrts in planning', assessment, and 
revisian of the program helped jkssiife that the^ obj ectives were 
reached, v^^^^ • ' . . ' . . 

The project sta^f^-^iso i^pfe^a wide Variety of consultants to aid in . 
the several phases of the program. Representatives from the region- 
al education service centers, the Texas Education Agency, community 
.prg animations , faculty from ojzher . universities , and the US Department 
af Jducat^on, added further rdepth to-the evaluation. The continuous 
input, through, the liaison personnel-, from the aides, teachers, anA 
administrators of the sever al/schools and districts from which the.y 
came, also gaVe an internal formative evaluation diirtensipn difficult 
,to achieve in most university programs. The liaisons* completed a 
standard form after each monitoring or assistaaC'e visits to tl^e 
schools, with .the diistrict administration , and when participating in* 
community activities. ^See the form in; Appendix B.) The information 
from these was integrated\ into the internal ;proj ect reports at mid 
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OF THE PROJECT EVALUATICa;? DESIGN ^ 
^—^ — ^ : — 1- 



— r 



Internal 



Sources: * : 

Un'xyer^ity Departments, 
Ca3J.eges ; Cen;f:rai' -Ad- 
* ministration 

" i» ' 

GQordin^tpr , ^Bilingual 
Education. . , ' 



Di3^ec.t6r, Title VII ^ 
: ESEA' Proj ect ^ 

External Evaluitor. 



Monitoring ; ■ 

Supervision of faculty and 
students , schedules* pro- 
grams«^; ancj syllabi. ^. .\ 

Academic advising and review 
of student' progress * * . 

General management and fiscal . 
control of pro j ect resources 

Feedback' from monitoring • ; 



External 




5s l/e^j^rtm\np of 
; '* Educated 

, Dall^s^ Independerit 
\. Schdol District 

othef participating 

districts 

Texas- Educ4tion Agency 



External Evaluat or 



Supervision of prograinrliatic 
" and *f is'cal elements 

]Recoiimendationi on, participants 
and programmatic aspects r 
feedback on , student progress 
/as they teach 

General supervision -of the ' 
certification prograjn and' 
course off er;ings 

Monito!i^ing of all activities . ^ 
through observations , interr^ 
view^ and document reviex^stV 
evidenced in interim aiid fi- 
nal reports and conferences. 
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year and at the conclusion o£ the year, thus they were not included- 
in this external report. Further, the information from the other 
internal evaluation activities were embodied in the project's re- 
ports" and likewise were excluded from ^the. present study • 

. # 

External Evaluation ' . ^ • 

In 1976, East Texas State University contracted with a private firm,' 
Development Associates with headquarterj[ in- Arlington,^ Virginia, and 
a branch office in San Antonio , Texas , to., perform* the external eva- 
luation. The company has conducted many local, regional and nation- 
al surveys, needs assessments , and evaluation studies 'irt the field 
of bilingual education. The agreement called for both formative and' 
summative evaluation for .the year 1976-1977. 

Dr. Earl Jones , senior associate and bilingual -education specialist, 
was assigned the major research tasks connected with the contract; 
His experience in bilingual education in Texas and Paraguay, and 
later in California and Guatemala , his proficiency in English an<i 
Spanish, his teaching, research, and administrative roles in schools 
and universities, together with his service in evaluating a large 
number of Title VII and other bilinjgual programs , gave him the wide 
perspective necessary for this project evaluation. (A curriculum 
vitae is included in Appendix A.) 

The 9ontract was renewed during the second year, 1977-1978. When 
Development Associates closed its Texas office, an agrecjment was 
reached where|)y Dr. Jones would continue the external evaluation 
with the East Texas State University program as an independent affi- 
liate" with Development Associates . Subsequently! Dr. Jones was. 
transferred to the San Francisco, California, office Of the^ companV 
as director of the Study of California Services to Liniited and non- 
English Speaking Students, funded by the California Legislature. The 
independent affiliate relationship was maintained for the East Texas 
State University contract and the later formative and siuimative 
activities were conducted under that arrangement. - * 

The funding for the formative and summative evaluation has always 
been severely limited. To maximize the utility, of the activities, 
therefore, the agreement called for the following tasks, each to 
serve both functions: . ^ 

^ . Monitdr'the graduate classes offered. 

^ . Survey sample bilingual education classes taught by the 

participating students. • 
. Seek information on the conduct of the program from both 
district and University officials. / 
^ . Study the documents related to the project or emanating \ 

from it. .- ^ 

.Confer with the project personnel and teaching faculty vn 
the implementation of the project. 
Recommendations were to be made to the project staff after each task, 
providing formative information for the improvement of the program. 
Two monitoring schedules were provided and conducted, and both oral 
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and witten interdin reports were suboiitted to t±ie director , / Sunroaries of the 
findings were incorporated-, when pertinent, within this annual report. 

As a resvilt of the first 'evaluation tasks 3 in 1977, including a study of the pro- 
ject docunoents aid conferences with p^sonhel;-va more precise investigation into 
the students' perceptions of the program was reconmendefd. Ihe agreenent was mo- 
dified to -include this facet. -.Ihe indtrutnents were then deriX/ed cooperatively 
by the evaluator, the project director, and the faculty advisory cotmiittee. The 
questionnaires were administered, the data analyzed, and the results reported in 
each of the annual and interim ^reports since then. At the, beginning of the pre- 
sent project year,' a rfeview of the results for the past several years showed a 
few questions- producing little of utility to the project. The instrunaent was 
appropriately modified and the present version, is contained in Appendix C. 

Monitoring 

Firiding pernlitted two sets of monitoring, one conducted in late fall and the 
other in mid- spring. Regular class conduct was monitored during alternate obser- 
vations of lecture, discussion, and other activities on the' home canpus and at ^ 
the Satellite Center in Dallas. Even alternate sessions did not cover all the' 
activities, and- at times, classes, and the information was supplemented through 
open ended interviews with a sanple of the students . Interviews with the pro- 
fessors and reviews of their syllabi furnished) additional data on the courses 
and changes that were effected in them. 

Additionally, a number of other activities of the project were monitored during 
the two periods: a special seminar by an outALde consultant, meetings with th6 
certification and advisory cocrraittees, a gerAral student meeting,, and special 
conferences with the Ihiversity President, t5e Dean of Education, and the Head . 
of the Department of Elementary Education. 

Project Docurnentation 

Ihe prf^ject proposal and its siibsequent negotiated modifications, the interim 
reports by the project personnel, and the continuation documents submitted to 
the US Department of Education, were provided for examination. Resource materi- 
als, research and class papers by students, • correspondence with several agencies, 
and the project arrangements with the Federation of North Texas Olivers it ies were 
reviewed. Evidence of faculty and student participation in professional actlvi- 
^ties was also furnished. 

Ihe Student Perceptions Study 

Ihe student stucfy was set up to provide interim data. Via student opinicns, on 
the conduct of courses, progress in Spanish, content or methods offered and 
needed, suggestions for inproving the program generally,, and ratings of their *. 
degree design. Additionally, the instruments were prepared so^'they could be 
coded and analyzed through ccnputer services to reduce the costs to the evalu- 
ation and to furnish longitudinal^ analyses across the years. « 

Thfe data analyses wei^e^ performed at the Corputer Center of Trinity University 
in San Antonio, Texas, the first two years, utilizing punch cards that could 
be input in subsequent years. These were later transferred to tape as the cumu- 
lated data became too bulky for punch c^d 'input. Ihe process was continued via a 
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compatible program at -San Francisco (California) State University 
^io^foJ^ ?o?7'"^* ^^^^ coding and analysis setup were detailed- in 
! i r iP^ report and are not repeated herein.) Versions 6^ 8 
5^;. °f .^l^V^t-i^ticai Package for the Social Sciences (Nie et al) 
were used. No names were used on the instruments but the students • 
includ^J' P^°^^d% their social security numbers; when thesi wire 
included longitudinal tracking of changes in their perceptions was 
Se^e°ITIo*doSe" studies, including all s?udentsr 

The instrumentation comprised -three separate forms. The first pri- 
marily sought certain biographical/demographic data to be used as 
possible differentiating variables for analyzing the long term re- 

Students , were also asked to rate their proficiency in oral/ 
nn ^L^""? ^e^^^Jg Spanish when they began the program. That rating 
on Form A, supplied the basis for subsequent analyses of progtess in 
!™ language. Form ,B requested, suggestions for improving the pro- 
gram and the individual courses, and obtained an update on^ the-ir 
fS^^if? proficiency. The opinionnaire. Form C, in keeping with the 
general University policy of student evaluation of courses, gave the 
opportunity for rating the several design and conduct aspects of the 
courses, an overall rating on eachr, and estimates of the amount of 
Spanish used by the students and the professors in the courses. (All 
three forms are included in Appendix C.) 

During the fitst year, the questionnaires were handed out during one 
of the last class periods with an explanation of the purpose.- The 
students were Mrged to participate. The professor then left the 
room and -those, students who wished to complete an instrument, volun- 
tarily, did. so, handed them to a student who sealed them ihto a 
stamped envelope and mailed the package directly to the evaluator 




they wished. Slightly more than 10% of them has left this blank 
across the years; 

The voluntary participation was disappointing' in some classes, to- ' 
tailing about 20% in one case and rising to about -801 in others. 
The student monitor had been provided a list of the .todents and was 
asked tonpte those that had completed a questionnaire. Because of 
the relatively low rate of return, it w.as subsequently decided that 
the list might have been a deterrent to responding; it, was thereafter* 
dropped The response rate for the .following quarter then rose dra- * 
matically. Again, however, the- rate decreased to its lowest level 
in the next quarter. Consequently, students were also given the op- 
portunity to mail the questionnaire themselves. Professors were also 
reminded to distribute the forms since interviews showed that some 
had neglected to do so. An increase was then experienced'^ but the 
return rates have varied considerably across the years since then. 

Substantial Increaseg in the instrument return rates have been exnerienced in 
the last three years: 135 in 1980-1981, 147 in 1981-1982, and 156' in 1982-1983 
A part of the increase is due to wore undergraduates taking .tiore courses but 
graduate students are also ccnpleting more evaluations. 
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As will be seen in the tables reporting the results o£ the analyses, 
the N sizes were small for some courses and some sessions. In some 
cour^ses, the number o£ students was quite /small, especially those 
related to research and the individual projects, appropriate to the 
nature o£' that type o£ work. Absenteeism no doubt also accounted 
£or some, of the losses. The voluntary aspect also reduced the num- - 
ber sent in. Because. o£ these circumstances, there was no necessary 
relationship between the number o£ respondents listed in the tables 
• of this report and the enrollment in the courses. The small numbers' 
weakened this portion of the study but could not have been avoided 
without prejudicing the rights of priyacy of the students. 

To ascertain whether the low response rate for jsbme courses biased 
the calculated replies, an examination of them jwas conducted. The 
study showed that excluding those with only one or two form^., no 

^necessary relationship existed between the numb.er of respondent's and 
the ratings; that is, students ;?ubmitted instr\wilents with low, med- 
ium, and high ratings in all'but four courses . In those , no weak or 
very weak ratings^were checked and only four fadr Replies were. regis- 
tered fot all of the different course components. In two of the four# 
only strong and very strong ratings 'were given.?. In othor courses, 
however, and often involving the same students , some very. low ratings 
were assigned. Interviews With some students were also conducted to 
examine the possibilities of biases and no direct, relationships ap- 
peared. Some students who did not submit evaluations state'd they 
simply did not do so; their stated ratings would have inqluded the 
complete range of ratings o.ffered. It is believed , theref6fe , that 
no substantial bias entered the ratings when three or nfore students 

'^completed the forms. ^ 

The instruments, as "received via the mail by the evaluator, were 
then coded and keypunched for statistical analysis,' The. codings 
were 100% Vierified, the analyses performed, and the appropriate tab- 
les for the report were prepared. The computer cards, for all the 
years to date were subsequently committed to magnetic tape for use- 
in future long itudinal analyses . - 

Two kinds qf data were transmitted to the project. The general in- 
formation included in the tables- in this report, plus the discussions 
with the -director , was the first and most important to the formative 
evaluation. Professors were given the opportunity to request private 
data on their ' individual courses but only two- did so. This annual 
report, includijig some analyses across the six years, was also to 
be tendered to the project director for the use of the University, 
the Bilingual Education Program, and the US Dfepartili'eAt of Education. 
The specific course designations are not disclosed within this re^ 
port to protect the instructors. • ' 



Limitations to the Evaluation 

Despite the several sources of information and the broad coverage of 
/^the design, one obvious weakness remained without investigation : the 
^impact of the program on improving the teaching abilities of the stu- . 

dents ^ch that their pupils learned more. Stated, more succinctly, 
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as a question, did the children, in the. classrooms o£ the studeiits 
learn more because their' teachers , were participatijig in this proj ect 
and degree program? The dif ficuTties o£ • such measurement are myriad 
and even controversial*. The subject should not j^A-\avoided, however, 
simply because measurement is difficult and iecfStise the* project 
Tacked the»£unds and other resources ^to- carry out such, a^ study. Se- 
rious thought tp providing .at least some tentative conclus^ns should 
be given and some resources should be provided by the US Department 
of Education or other entities to conduct this important research., 

-Finally, the funding provided, for external evaluation was small and 
the investigations, therefore, were necessarily brief, even in some 
cases ciitsory. .The report must be taken within that limitation. 
Despite.^this handicap, a great deal of Useful informatibn was fur- 
nished throughout ^he study and that information helped the Univer-^ 
s^ity and the project improve the program and its 'services . ' The- ex-" 
ter»nal evaluator knows of no events or processes that were not scru- 
tinize'd and therefore submits this report with confidence in the 

J findings unless otherwise stated. 
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PROGRAM. PROCESSES •. 

East Texas State University has operated the ESEA Title VII Bilingual 
Program for seven years. In the first year, development activities ocetpied a 
large, part of the administrative time and the program waS begun at a 
highly ' functional rate. Seve'ral important- changes were, made during 
the year to strengthen both the participant benefits and -the manage- 
ment' capability so that still further ' improvements could be made in 

the future . • * . * 

"•' . . • 

During the second year, -the major processes were associated with the 
consolidation of management,, enhancing the resources and services ' . 
/ available, to the participants and faculty, and- the ^extension of the 

work to include -a larger number of agencies and community institu- 
tions. The early' cooperation with the Dallas Independent School Dis- 
trict was continued and the McKinley Independent School District was 
added.* East Texas State. University membership in the Federation Bi- 
lingual Training Resource Center i'ncreased the 'resources available 
to thfi Title VII program and in return, the University contributed 
experience based knowledge to the management of;the:,Federation ope- 
rations. An augmented thrust ttie second '^year was the strengthening 
of the work with the Mexican American cotinnunity, especially in the 
, . principal target area, Dallas, both by including that segment of the- 
population in the management aspects of the program and in providing 
leadership, enhancement services to its members*. 

•In the third year , with/ the processes tt^en principally at a .routine 
leve'l , the program further consolidated its service offerings and 
maftagement systems, continued its work with the North Texas Federa- 
tion and the community, and expanded its service area. into new diis- 
tricts: Diocese o£ Dallas , Irving, Garland, flano , . Ehnis ,-' Mesquite^ • * 
Mt. Pleasant, Paris, Tulia, and New Braunf els . Students were drawn 
from an .even larger area while. the participation from Dallas was in- 
creased> From the beginning relations with thie Texa's Education 
Agency, the 'educational service centers , . and other xaniver^ities in 
the area were improved. One new element ih^ tjie program was meetings 
with Native American groups to explore ways to serve, .that community 
component. Another addition was that of of fering l^owrses 'i^ Teach.T 
ing English as a Second Language in cOT;ijUnction witlib'^^e Texas Edu- 
cation Agency. This was a valuable adjunct to the prpjgram and of , • 
inestimable * assistance to the districts since little training '.in that 
field had been available previously. ! / - 

The fourth year showed further consolidation and expansion 'bf the 
program. The courses were updated and additional materials. were- in- 
cluded as they became available. Permission to grant a doctoirate 
was. sought and granted, and the federal funds for 'a few schol airships 
for that level were obtained.' Specialist programs beyond^ the masters 
degree were also inaugurated. The number of undergraduate students 
was increased and the masters program continued to grow. Beginning., 
efforts to provide ^assistance to other language groups, notably Viet- 
namese, were studied. The University/Texas Education Agency offer- 
ings in Teaching English as a Second Language were continued. ^ Funds 
for the leadership development work with the Mexican American 'and 
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other comqanity constituencies were not granted fdr this year but a part of that 
_loss was taken up by student participants that oarried out die work voluntarily, 
The^rthJTexa^ service activities were also, discontinued; the several 

universities eneotrpassed a part 'of the w5rk within their regular prograns but the 
loss of the considerable financial resources was significant. . ' 

During the fifth project year, East Texas State IMver^ity was able to increase' 
the participating student nmibers even thoiigh many col-leges :were experiencing * 
sxibstantial decreases. Further, nbre and more students w^6 being attracted %g 
the program from other parts of the state, from other greas of the US, and from' 
Mexico. A bilingual Science educator was added to the faculty. Ma«agement ' 
' "ehahg(BS were needed, also, to relieve the enormous burden that was shouldered by 
, the adriiinistratqr^ and the University was able to modify its staff ixig to inprove 

thfe cdndi'tion. The library continued its afcquisitions and the Satellite Learn- 
'*ing Ceritei: obtained a nuch larger holding of bilingual reference materials, as 
well as provivide more space for the staff. • . ^ 

\Tlie sixth program year .gave more aiphasis to the undergraduate instead of the. 
rgraduate level; the mdergraduates enrolled in greater numbers' and there wa§ 
som? decre^e in graduates. -' ^An ehdorsemgjt plan to add^ English as a Second Lan- 
guage to the teaching certificate was approved and begun in operation. Several 
changes in the i^per. echelon of liiiversity administration wer^ made and the new ' 
officers were oriented to the bilingual; program. 

t' ■ ^ ' ■ 

'Year, seven saw the proportions o^ undergraduates and graduates remain about the 
same except that fewer doctoral fellowships were available. Administrative, exi- 
gencies caused a consolidation^ of the two managanent posts into one; the long ' 
experience of the coordinator made it possible to continue effectively with the 

* appointment of some of thp faculty menbers to graduate faculty status and thus' ' 
able to share the advising load. The news .organ, Boletin; was>renove(i from the 
.budget but coniiiunications continued at a'sati&fisictory. levels 

-,4. ' ' - ^» . ■■ ■ • ' ■ 

■ ^ Administration- 

' ■ \ ■ ■ ■■ 

A major strength of the Bast ^Texas State iMversity ESEA Title VII program was 
the dedicated early leadership pf the director and assistant dlrectdr. Iheir ^ 
experience through the first four years allowed a careful transition from a be- 
ginfting effort tp one that operated with professional expertise. Their incotpo- 
' rat iott" into the regular liiiveirsity faculty furthered the program institutionalir 
zatiorl q^d iiqprovement . « . « 

•Contrary to arrafigementzs in some' ESEA. Title VII projects, * the personnel of the 

East Texas State University program has the full range of pr<ifessotlal duties: 
'jteaphing, advising, connittees, and administration. Institutionalization is 

therefore much higher than in most others; the work loads, however, are greater. 

\ '■ , ^ y ■ ' . * 

. The cooperation. among the personnel of the project, the.d^artments, and the col- 

leges not only continued tait. was increased, even though some of the persons oc- 
. ojpying. the administrati^ve positions changed. A part of the continuance the 
•J' add4.tion of personnel that knew about and supported bilingual education. The 

* administration helped provide an environm^t* in which the project could flourish. 

The new President, Academic Vice President, and Graduate^Dean con;f erred with the 

coordinator and supported his efforts. Hie Dean" of Education anfl Head of the 

Departgient of Elementary Education continued their active participation. 
1^ - 
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The office space allptted to the project last year was modified someKf^t but the 
new..arrangemi2nt is efficient ^ sixice it provides a rec§ption/ typing area, a pri- 
vste office for advising/administration, and separate room for the storage and 
contrrol of the frequently vise^ demonstration ahd reference materials. The latter 
furm-shes much greater security for the mate^aals since they must be checked in 
and out, and at the same tiihe provides an office for .the graduate assistant". 

Changes in state laws and' regulations necessitated their study and sometimes in- 
coifporation' into the teaching or management within the program. Often these re- 
''suited in increased contacts with districts participating in the progranjs and 
comunications with neiw ones. They naturally entaiypreparation by tjie staff 50 
that whether affecting districts or the University, they can b^ incorporated 
with a minimum of distraction ftcm the primary JEunction, that of preparing -highly 
qualified teachers, administrators , and special staff members. The project paid 
close attention to ^the proposed changes and managed them well^ 

\ _ • .^4 ' Inter-Agency Cooperation 

The University Title VII program cooperated fully with the Federation Tr£ 
Resource (Senter during its existence; it continued that cooperation with 
Federation and its members when that center was disbanded. Moch of the' 
•nation this year^ took place through the Fort Worth Region Service Center; 
staff worked individually iii producing many materials and served on several(of 
the advisory ccranittees for its functions. - 

Discussed in another section, ^be program cooperated with the Texad Education 
Agency in offering specific traiJ|ing in the teaching of English as a Second Lan- 
guage. Staff mecnbers also assisted in the ffirmulation of the provisiGjn^ plan 
for the endorsement to the teaching • certificate in the beginning considerations 
and later > submitting, through the* Certification Conmittee, a .model endorsement 
plan. The liiiversity's ^experience in offering the courses for the Texas Educa- ' 
^ ^ t^on Agency not only* helped the Agency in its planning efforts but also prepared 
the University staff and the comiitteles for the development of its cmci plan. 

Students fron East^Texas* State Uiiversity- and the other ^^^embers of the Federation 
also continued their mutual credftong of specified courses anywhete within' the 
groLp. This allowed for utilizing the greatest strengths of each University as 
well as facilitate early endorsement since thie teachers could attend the insti- 
tutiort'most favorable to their schedules. - 

^Siiralarly, the liiiversity personnel aided with many activities of the Mexican • 
American CCTimunity, both to help in the* development of the conmunity and as an 
'^"^jjpression of its sii^^port. The ,Cinoo de Mayo and National Hispanic Week activi- 
ties were enhanced by the support of the students and faculty. 

In addition, and as a partlpf its own caniunity, the program cooperat% with- ^ 
the canpus organization, Asi^ciacidn Cultural de^ispano Amerieunos , hewing pub- 
licize the organization and its activities. This was a nattpral extdnsicn of the 
program. The project also assists other organizaticns for foreign students at J 
the Ifciiversity and,' in turp, obtains their help in the preparation for and conduct 
of the many imilticultural efforts needed to train teachers for work in their dis- 
tricts. Since the program cannot possibly possess all the materials it needs for 
so many .cultures, the cooperatiOT^ays substantial dividends. 
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^ . ^ . ' InstitxitioTializaticjn 

East Texas State University continued to svipport the ESEA. Title VII program and 
to incorporate it directly iiitq the regular structure of the University. The 

• previoicly noted office space^-.and division of administrative responsibilities 
are cases in point; In addition, special evidence of institutionalization was 

dononstrated in: " ' ' ' . . 

• . ♦ . ^ 

" * • All the teaching positions were held by tenure track staff except one 

ahd discussions for. resolving that remaining problem were underway; ' . 

• The undergraduate and graduate endorseitent requirements for teaching ^ . 
English as a Second^ Language were proposed by. the faculty and approved 
by t^e Texas Education Agency; 

• All other certificate and_.degree programs were formalized and appearfed 
in the undergraduate and graduate cataHjogs; 

. Library holdings i^i. bilingual education and related fields were sub- 
stantially expanded on the home canpus and the Satellite Learning . 
Center- 

The faculty ^^ttength in delivering, a part of the ii)struction in that language 
remained at a high level, not only in the bilingual education staff but also irt 
' several other departments that contribute to the instruction . - ' ^ 

The bilingual education coordinator and the external evaluator met with the new 
President of tiie Iftiiveirsity shortly after he assumed his duties to present an 
overview of the* previous years of work, the results of the evaluations, and the 
strengths and areas needing inprovenent . The Dean of the College of Education 
continued in strong support of the program. The new Graduate Dean and the new 
AcSademic Vice President had already worked with the bilingual educatidti faculty 
, and their continuing support was assured. . 

All of tiie interviews with the Ihiversity officials produced expressions gf 
their concerns and cocnmitment . The desire to fully incorporate the program com- 
pletely into the University structure remained undiminished?, even though the 
: full realization of that aim could not be totally acconpl^hed. The IMversity 
*^has, however, institutioialized the ESEA Title -VII prograriKihto its regular 

structure more than any other known by the evaluator. ^ ■ 

The evaluator would like to enphasize the diipottance of . this aspect of the East 
Texas State University approach to the Title VII project since, he also" works 
with other university training programs . It has been relatively easy for some 
universities to grant special status to a federal program, exenpting it from the 
usual control and adninistjrative mechanisms-. . The projects have almost always 
suffered later.- Cessation of the gr^t, difficulties with degrees and/ or credits,' 
" permanent faculty appointment omissions, and similar problems have often resulted 
in the disappearance or* substantial reduction in the university offerings and 
services. Miile obviously East Texas' State llkiiversity needed federal support - 

* six years was a relatively short time to inplement a program that was a new field 
- and especially ^en-the increased demands for bilingual teachers were still evi- 
dent, there was' undeniable evidence of the incorporation of this program into 
the regular offerings and structure of East Texas State University. It was a' 
clear case of 'federal monies well irwSfeted fpr the future. Additionally, the low 
income level of 'many of the partieifwnts justified the aid from tuition assis- 
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The University and the project continued to make important moves in 
improving the capability to deliver bilingual teachfer training. In 
addition to the appointments cited in previous reports, several de- 
partments have added fatuity with demonstrated ability to work in 
bilingual education and the necessary related fields . The Universi- 
ty has an imusual strength in that tield and in -teaching English as 
a "Second Language. 

The University was also able to reduce its dependence uppn* adjunct 
faculty. Such faculty members, even when, chosen with a gt'eat deal 
of care, do not always produce the highest amount of., student learn- / 
ing . The one ^long term adjunct has the highest ratings in the faculty and was 
promoted this year. * 

,0' ■ • ' 

The University faculty was observed to work hard in making the pro- 
gram a success, closely following the degree design specified for 
bilingual education ^ The students perceived some weaknesses and 
those are detailed* in a later chapter. Some part of the. weakness 
was due to the field itself - the relatively small amount of objecr . 
tive research relating implementation to student performance. Some 
progress' wag noted in this regard: the study for the .Calif omia Le- 
gislature; a series of articles in, the leading TeacKer and the AERA 
Journal'; plus evaluations of small projects described in the ERIC 
entries. The faculty was aware of the new materials and were in- 
corporating them'' into their instruction. 

Another source of the complaints voiced in the interviews was the 
many non-program courses taken<,by the undergraduate students, who 
were' in the majority in 1982-1983. Students criticized poor pre- 
paration for some classes, dwelling on inconsequential material, 
and in a tew cases, insufficient attention to their needs. V^hile 
no university condon^gs these problems, the number of . complaints • 
was probably no greater than had the students of other programs 
been queried. ' 

Most importantly to the long term view of the teaching, the number 
and severity of the complaints about the quality of instruction in 
the graduate courses decreased markedly. The renovation of the syl- 
labi and the tk:w -continuous coordination of material at:ross courses had 
largely "Eliminated the source of some graduate criticism. 

Unfortunately, one area remained problemmatic for the xandergraduates', 
that of ' the Spanish instruction. It must be noted, however, that 
some improvement in the ratings occurred, chiefly because one pro- ' 
fessor not previously included, was judged by the students to in- 
struct well. The complaints registered in previous years about the 
denigration of Mexican American Spanish ^and about courses taught 
mostly in English, * continued for two of the professors. The matter ' 
wasi again brought to the attention, of the administration and re- 
views were promised. It must be emphasized that the graduate cour- 
ses in" Spanish were rated very high * 
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The discussion o£ these problems is necessary but it should not be 
^ t^en as ^^a condemnation o£ the teaching within the program. To the 

* contrary, the student ratings o£ the courses- and the observed con- 

't6nt coverage^and teaching methods showed exemplary professor capa- 
bilities iiTlnost o£ them. "Tough but thorough" was a typical expla- 
nation for a professor that from the beginning has always had high 
rating^s. "Demands a left of wqrk but teaches well ,". "knows bilinjgual 
education techniques and shows us how they should be conducted,", and 
"it wasn't an English 'course but my writing improved because he de- 
^ manded it" were :other important responses , "I learned research in 
that course that wasn't even on research" was a complement atny pro-, ' 
fessor should be happy ^o merit. In summary, then, alnost all of 
the professors in the program taueh^ what they should and did it./ 

•well. No program coiild ask fprvmore - except to ^nsist that all^ pro- 
fessors do that. ^ . r - . * : ' . 

.The amount of ^Spanish used in the classes has not . increased much over 
the years. In some classes, 99% was conducted in that language; in 
others, nearly none. Several factors contributed to the differences. 
In^ some classes , there were so many monolingual English speakers that 
the professor would have been in error if he had conducted the class- 
*^ - . es in Spanish. Some professors, pf course, did. not speak fluent 

Spanish ^ut most 'of these at least tried tq use what they knew. One 
important technique* observed in one course was that the professor, 
limited in Spanish, wprovided the necess-ary vocabulary for the content 

" by writing the words on the board and obtaining help from Spanish 
. .speaking students in explaining them.. Still another, who understood 
a great deal of Spanish but could not speak wfell, insisted ^that the 
^anish speaking members of the class respond in Spanish. That, too, 
, ' was a perfectly acceptable technique. In general, then, and consi- 
dering the several factors, the amount of Spanish utilized in the 
courses was 'probably at about the level it could be. If the enroll- 
ment were higher ,. special Spanish sections could be formed but under 
the presehtv. circumstances, the various efforts to use that language 
were commendable. - , 

The evaluatbr has had. many opportunities to become well acquainted 
with some of the students who, because of necessary part time work^ 
still remain. Two areas of improvement in oral Spanish have been 
noted in them: they used Spanish more and they made fewer errors. 
The increased vx)cabulary of the Spanish, speaking Mexican Americans 
was notable. Vocabulary and pronunciation by the non-Mexican/Latin 
Americans improved. Students were also . producing more project work 
^ in Spanish and that work was more accurate. Spelling improved, more 
diacritical marks were included, and the grammatical construction 
showed a better grasp of the language'. An examination of some ele- 
mentary teaching projects, fbr^example, revealed few errors and even 
fewer clumsy phrasings. The writing in Sp'anish definitely increased 
and improved. ^ ^ f ' 

The general teaching practices of the faculty also improved. No ccxn- 
plaints about lateness or absences of faculty were registered. None t^tss alleged 
to have come to class unprepared. Three students suggested that one professor 
would be bietter with more elementary classrocm experience. . The observed prepara- 
tion and subject dominance were hi^; Student participation was excellent. VMle. 
to an outser thes.e would seem to be e^q^ected qualities, the reality in university 
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work, the reality in many university courses is less than desirable . 
i^^rfonnance. East Texas State University definitely improved its' 
. / teaching in the classes Associated with the bilingual education 
pirbgram. 

Not content with the present status in teaching, the project has 
continued its faculty development program with even more attention 
t 6, instruction. Several seminars were held, both on the content 
of bilingual education , and related topics, as well as on the metho- 

'dologies for deliveting them. Too, the University produced a stu- 
dent evaluation ^ of the instruction and it was instituted during 
last year. While some professors were dissatisfied with the new 
system, the institutional pressure to improve instruction remained 

.strong, as ey.idenced by the adoption of the evaluation. 

Prof essionalization , 

r , 

The intensive duties of the staff in combination with the work in. 
project and in^regular departmental functions demonstrated an un- 
usual commitment. It also restricted some activities that might 
lead to greater prof gssionalization . Nevertheless, the faculty 
members found time to work on some research, consult with other [ 
tiniversities and some districts, and conduct eva.luations . :The fa- 
culty continued to show its concern for professional development. 

In the process of adopting a certificate endorsement. for English 
as a Second Language, the Texas Education Agency requested input . 
from several sources; The. project staff participated in one held 
by universities with bilingual education departments, presenting 
a provisional plan for a degree and for a certificate. Thi? State , 
\ , evolved a tentative set of courses and East Texas State University 
was one of those asked to provide suggestions on it. .Additionally, 
a special English as a Second Language subcommiTitee of the bilin- 
. gual education committee drafted a proposed plan for East Texas 
. State University and it was accepted almost iri its entirety, making/ 
it possible for some students to begin work on the endorsement al- 
most immed^-ately . 

• ■ . ■ . > « » , 

The faculty persisted in its work with the Texas Association for 
Bilingual Education, the TESOL group, and the Association of Teach- 
ers of Foreign Languages. .Even though no funds were available for 
some meetings , faculty members paid their own way to participate. 

A strong interest in professional reading was manifested in several . 
faculty contacts. Some cited recent articles and research reports, 
.commented on evaluations and new measurement procedures, and in. 
other \*ays demonstrated a^ good grasp of what was new in bilingual 
education. Faculty use. of the two data retrieval systems was evi- 
... denced. The use of the many bilingual materials housed in the ^ cur- 
riculum library, the inain library, and the Satellite Learning Cen- ' 
ter was high. The library ' continued to respond to student and fa- 
culty needs by increasing the holjdCngs . A notable production was 
an annotated bibliography on bilingual legislation\and court Cases 
produced by one- of the librarians. - 

— DEVELOPMEXT associates, IXC. 

19 

■ 24 ■ -^^em::^ 



ERIC 



' " ~ '■ ~' * ,' ' . ^ 

Strong evidence of profess ionalization has been continuously noted throughout the' 

project's life^iii the annual reviews of the offerings a:id modifications of them; . 
as required. Thet 1982- 1983 study' produced some substantial dianges in the mder7 
graduate and graduate degree programs for bilingual education. Some cfourses had' 
alreacfyj beeii introduced for the English as a Second Language^ efidoresement. The 
• latter was formalized this year and accepted by the Texas Ejjucation Agency. Si- 
milarly, the revi^ons to the degree and endorsemeat plans for the bilingual edu- 

_cat ion portions were approved. (See i^endijc A for these plans.) . . 

^ ' • . ■ ' * 

Articles were submitted to area newspapers,, radio, gnd television, programs , and 
these, plus direct letter- cooinunicatiions continued to aid profess ionalization. 
These further helped reduce the effects of the loss of the p¥^)ject newsletter. 
The canpus and fadulty newsletters also aided in keeping information flowing. 

Graduate student researSph, produced primarily in partial fulfillEnent of the re- 
quirements of the research methods course, continued to show high quality. The 
' publications search, treatnient of the materials, and clear dLs tine t ion between 
the reporting and conclusions sections, were major advances. Three exanples - 
"Bilingual Education as it Relates to'IESA and non-LESA Students," "The Influ- 
ence of Child's Self- Concept on Reading Achievement, and "A Conparative Stud^ 
of Pre and Post Test Scores of ^ Kindergarten Children Usipg the Caldwell Pre- 
school Inventory - denote' the difficulty of the topics mdertaken, an indication 
of the seriousness of 1±ie graduate student work. 

Professionailization in the East Texas State tftiiversity ESEA Title VII project is 
at a high level. Plans for future studies and inprovements will further that end. ^ 

Ccpmunicty Involvement 

Although Title VII no longer funded the direct ccranunity involvement activities' 
of the bilingual program at East Texas State Ihiversity, the previous wDrk was 
conducted so well that many continuing efforts could s till' be noted. Cotnnanity 
'leaders trained in earlier years remained active , promoting specif ic benefits 
for their coranunities as well* as inproving bilingual education: Faculty maiibers, 
former students, and cuhrently enrolled students were still contributing Their 
skills to community development. Parenfal assistanpe with many activities in 
the schools with bilingual education remained quite high. The inportant wDrk - 
begun through the project was still paying dividends. ' i ^ ^ . 

A second kind of involvement, that of the teaching ccmnunity, was evidenced all 
through the present year. Teachers and adminis tratoys from the school districts 
were inclxoded in the advisory conmittee to the project; they were used as^ re- 
sources for the work and contributed, a great deal to the formulation of the gene- 
ral policies and the conduct of the program. They were not seen as "objects" o£ 
the prpgram, as is often the case, but as integral cooperators in a design and 
delivery system. - 

Yet another inportant evidence of. the project's professional concern for the in- 
clusion of the district teachers and' administrators into the Title VII program was . 
the consultation sought by them when problems arose in their sdiools . These re- 
/ quests for assistance arid information have increased measurably across the years. 

. Not content with canpus consultations, ,the East Texas State IMversity, through . 
its Title VII project ^d its own resources, provided in-school assistance via* 
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the wor^ p£ the liaison persojrinel. Every sjaff member was s^en as 
a part o£ that system' to .provide services *to, and at the same time 
g^Lther information on needs from, the district persbrinel •/ Sj^eeial 
liaisoii \^6rk vjas assigned as a part o£ some faculty "members* work 
to ensure timely del ivety of services, to the schools and to ^the 
students; Regular visits were made to the schools, with advance 
notice, and assistance was givexj when requested. Further , reppVts - 
on the monitoring of cl^a^^es' and on the assistance rendered' provi^-^ 
ded a. feedback to the project so it ycbuld .improve, \ 

^ . ' ■ . •'■ V. ■ . 

The student evaluations of the liaison services have been njore and 
more favorable through the pro j ect: years . (A ;io|igitudinal report , / 
is included in a later sect ion. ) Some of this p*ositive increase, ' 
of course, was- due to the augmented capacity of the. project to de-, 
liver this kind of service, th^ ratings also showed, however, ^hat * 
the teachers and. administrators recognized that th6 University and 
the project could pr^ovide specialised se^rvices' to bilingual educa- ' 
tipn in their schools., 1 v 

other evidence of the Vrecognition of the willirig^ness and lability 
of the East Texas State University Title VII project to help vfith 
educational problems wa^ that -of the increased- number of cooperate 
ing school districts^ As new laws and regulations were promulgatea, 
more and more districts called on the project to assist with cojnpli- 
ance. Some districts have begun the planning and^implemehtatibh/'Of 
"•-bll^ingual programs with the advice and counsel of project personnel, 
have urged their . teacjiers to participate in the credentialing • jt^ 
courses, and have made contributions, to the work of the program, ^ 
ATl:1 of these, even ..those of only early formation, denoted acceptance 
of the Title VII project and its concern for^ involvement between :^he 
University and the districts . / • • 



While there are man/ positive sections to this evaluation report,?, 
probably no pjiase of the East Texas State University project reached 
tlx^ high degree of realization as' that of /prof essionalization,' ' The 
evaluated university programs in Texas, Arizona^ and • 



author has eyalu-ated university programs in Texas 
California and has never found the superior quality, evidenced at 
East Texas State University. The project lyas well integrated ihto.^ 
the Univers;ity, the school districts^ sfntHt^ie communities. This 'V 
commendable -e in the project should be disseminated to other - 

university .projects and the personnel should be asked to assist 
others in. achieving such a high^^degree of cooperation. Much of the 
project 's success in other endeavors wi/thiH; its program was directli0 
related- to its commitment to .prof essionalizi^tion - to its competence 
in the .dflivery of services to/ every p^rt of its community^. ■ 

Communications ' ' 

The communications efforts were evident from • alt the explanations iii 
the pr envious sections of this report/, but they bear repeating for 
emphasis.' 'The project.. worked hard at maintaining "a; dialogue 
all its audiiences: stat.P'^^gencies , ptH'er uni.versities ;^ i^^^ 
vers ity componeats^; thje ;a^ , ytlie Mexican American- comnmriit^ , 

.and the students; - It .actively proyided information a^d -sough 
formation from- them, ' ^ ' ; • - ^ 
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Resource Facilities : ' 

' TbeEi5t Texas State Uiiversity project was especially cognizant of the need to ^ 
^jrcHdde a wide range of resource materials for the use of the faculty and stu- 
dents,' While few Title VII funds were used in* this acquisition, the project 
stimulated the collection of many materials and t±ie accunulated resources were 
miisxjally' lai^e f or >u^ . " 

The canpus library has been a major force *in providing the resource materials. 
' Priiiiarily utilizing its cwn funds, this lliiversity component collected one of 
, the best setS: of materials yet examined by the evaluator. The collection was ndt 
6nly. coninendable for its 'materials on bilingual educat^-on but also oc\ linguistics, 
Spanish, English, history, sociology, psychology, anthropolosr, and many other ' 
relate;! fields.' A part of the credit for this collection also was- due to the fa- 
culty examinadLOTi of the literature and suggestions that would further the study 
of 'their fields. 

Seine sp>ecialized curricular materials have'b<Sien purchased with Title VII fvspds 
over the years and these were housed in al ^special office near that of the pr^9*^ 
ject to provide control over them. These incliode materials for nearly every, 
.grade and have been reported as unusually helpful to new districts offering bi- 
lingual ar^ ESL education, as well as to established ones that want to change 
.their curricula: / ^ 

East' Texas State liiiversity alscf maintains the Satellite Learning 'Center in the 
^llas area and it, too, housed inportant materials to the work of the project, 
le site facilitated the use of the materials by tl^g part time' students who 
)rked all day and had fewer opportunities to study on canpus. 

Theprofessors who taught in the learning center also carried great amounts of 
books and ^curriculum sets with them, further increasing the exposvnre of the stu- 
dents to the special materials. They also carried some audio visual materialis 
with them, adding student knowledge of \^hat is available. ' 

^ . ' 

The arrangQoents with Dallas and the otiier- participating districts also made more 
teaching materials available. Similarly, the Federation arrangement with the 
other North Texas ijniversities inclioded the use of their libraries, greatly en-, 
hancing the resources with fewer funds. 

Sunmary of the Process Variables 

The East Texas State liiiversity administration had gone tq unusual lengths to in- 
corporate the project work into the regular University structure. While it had 
not yet beea able to manage all of the institutionalization that was planned, 
primarily because of financial constraints, it had achieved far more than any of 
the other Title VII projects t;^ evaluator had studied. - 

Inter- agencj^ cooperation was high, especially with l^e participating sch&l dis- 
tricts, the pther merrbers of the Nor^ Texas Federation of liiivers it ies sXhe , Tex- 
as EduCatiorCa^encyyand its .service centers, and among the depaci^ients^ and. col- 
leges .Qf the home^ institution. Despite son)e major changes in tKe^'tMiversity ad- 
minis tSrSt ion, the projeict retained its support. The new officers took tinie to 
beco[i£| acquainted with the work, the staff, and the evaluations. The assistance 
from phe Dean of Education remained exenplary. Ccnnunity involvement with the 
mar^y populatiofi corponentS' in the areas^'bf concentration, within tjie liiivgrt^ity,. 
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and with professional colleagues was very high; the combination was comnendabl^. 

In; review, ^t Texas State liiiversity and the ESEA Title VII Bilingual Progr*a 
made s\±>stantial strides toward tJie* best possible delivery of services to the*, 
students, the districts, and ultimately to the limited English profidient child- 
ren in the State. The officials of both are congratulated for their persistferit 
efforts toward these goals. j • - 4'; • 
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THE STUDENTS IN THE PROGRAM 

East Texas State University conducted a needs assessment on the 
.training- required in the North Texas area at the beginning of- its 
program. Utilizing the data available from the. Texjrs Education 
Agency, published research, and surveys In the imm.ediate geographic 
region, it was evident that the deficiencies in all levels of ire- 
sources to conduct bilingual education were critical. The Mexican 
American population was growing very rapidly in the Dallas and Fort 
Worth area^s ; moderate increases were noted in the smaller popula- 
tion centers throughout the North Texas portion of the state. 

The first thrust, and still the largest in terms of numbers, was the 
provision of bilingual education methods and techniques to already 
certified teachers in elementary schools. Two options were avail- 
able: the courses needed for the endorsement ta the elementary cer- 
tificate and a full masters^degr^e program in bilingual education. 
As soon as this program waSSj stabilized , the University then planned* 
and negotiated approved programs for undergraduates so they could 
enter the bilingual education field directly; a specialist program 
beyond tlie masters degree was needed that would equip experienced 
personnel to aid the administration and teachers ,in the implementa- 
tion of bilingual education; and the doctorate in education, which 
would provide both specializations and at the same tfme furnish 
high level personnel for othej. functional positions in universities, 
agencies,, and local administrations. • 

All four levels were direiy^eeded throughout the North Texas area 
and the nation. Increases in the number of pupils that could bene- 
fit from bilingual education and programs to serve them, have kept 
the demand high. The four programs are still needed if the students 
in elemeittary and secondary schools are to be educated within an en- 
vironment that will facilitate their abilities to enter, profit from, 
and contribute to the educational, socibl^ political, and economic^ 
life of the state and t^e nation. V 

^ ' 

Program Participants 

The majority of the East* Texas State University Title VII partici- 
pants came from the Dallas Independent School District , which co- 
operated directly with the program. Many others, however, came from 
other* districts in the North Texas area, and recerftly, from all over 
Texas . / * 

In the early years, almost all the participants were teachers in the 
first four grades of school since that was the emphsisis for bilin- 
gual certification. Since*that time, the numbers of* participants 
from the other grades and from other pcfsitions in the schools have 
increased markedly, demonstrating an attraction to the' East Texas 
State University program. That change is significant since several 
universities in the area offer some levels of training for bilingual 
.education. 
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The University guarantees the privacy of information, therefore, th^ reporting . 
oh the several characteristics studied is voluntary. Too, tnany students parti-' 
cipating in the covnrses were not assisted financially by Title VII. The two fac- 
tors conbine so that the percentages cited in the acccopanying tables do not ne- 
c^sarily translate into the nunbers officially registered as ESEA. Title VII 
participants. , 

The wide variety of occipations of the reporting participants is displayed in 
Table 1. The changes across the yeats represent differing ecnphases in the 
schools, on the privisioh of bilingual education and ESL in different grades, 
and the group receiving special assistance from the project. 

Table 1: Conparative Frequencies of Reporting Participants by Occi^aticn 6:an 
1976 to 1983 





1976 


1977 


1978 


1979 


1980 


1981 


1982 


1983 


Occupation 


7o 


7o 


"/» 


,% 


7o 


♦ 7o 


7 


7o 


Teacher: kindergarten 
^ grades 1-3 • 


10 


12 


12 


14 


t 12 


4 


3 


1 


36v 


47 


48 


43 


30 


27 


22 




grades 4-6 


13 ' 


V-13 


14 


4 


15 


12 


9 


12> 


grades 7-8 


4 


_ 2 


4 


8 


3 


8 


6 


* 


grades 9-12 




1 


4 


7 


7 


6 


5 


14 


adult 




0 


0 


0 


0 


0 


0 


1 


Aide 








** 


6 


8 


5 


0 


Volmteer 


0 


^ 2 


0 


0* 


1 


1 


1 


1 


Administrator 


2 


3 


6 


6 


2 


3 


3 


Ccxiputer/ineciia . 


0 


0 


0 


0 


1 


1 


0 


1 


Curriculum writer 


1 


2 


2 


2 


3 


2 


1 


1 


Resource teacher 


1 


1 


2 


2 


4 


0 


1 


1 


Student/unenployed 


** 


** 


** 


** 


6 


18 


42 


38 


Unspecified other 


15 


13 


11 


24 


1 


4 


1 


0 


No response 


1 


9 


0 


0 


. 0 


3 


'2 


0 



-k 



Grades 7 through 12 were combined into a single ''secondary^' response, 
^Between the 1979 and 1980 reports j the compiiter program was expanded to ao- 
f count for these specifications formerly grouped under "other." 

The principal drawing area was the Dallas area*; as the teachers thpre gained the 
credential and/ or degree, decreases were es^cted. .However, these wete partially 
offset by the inclusion of other area districts and py losses from alreafly 
prepared teachers. The large increase in students that were unenplqyaed mostly 
resulted from the changed arphasis to funding that group. 

The total and bilingual teaching experience of the students in the first few years 
was fairly stable. As many of the experienced iristructors ccapletfed their -certi- 
fications and degrees, the total experience diminished.. ^ The bilinigual experience 
continued to rise until 1982, when the higjier proportion of undergraduates dilu- 
ted that factor. Similarly, the 1983 offerings for ESL teachers, inany of vhom 
do not teach in bilingual education; decreased the experience variable for bi- 
lingual but not the total years. Table 2 cocnpares the frequencies for both to- 
tal and bilingual e:q>erience for the. last five years; 1979 was representative of 
the previous project years and thus the entire project period would have added 
little to the information. 
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Table 2: Conparative Frequencies of tiie Total and Bilingual TeacMng Experience 
of the Participants: 1979-1983 

Total Bilingual 
^^oS^s ^575 ^5^0 ^5S1 1982 1983 1979 1980 1981 1982 1983 

None 

Less than one year 
One to two years 
Three to five years • 
Six to ten years 
Eleven years or more 
*Nq response 

' ^ ' ^ . ■ ■ % , .. 

The relatively large increase in tiy^ "none" category in 1983 y/^reri cccnpafetfrto 
1982 represents mostly those teachers retiiming to the Uiiversity to gain tifie 
ESL training, many of \ivcxn had not been involved in bilingual educatiqp. 'fiie 
nunber of undergraduate students, also a part of the "none" category, remained 
about the same allixougji their percentage of the total reporting vas slightly 
smaller than the previous year. - * 

The proportion of male to female students vas stable the last four years with 
only minor variations . (Table 3) The proportion of males continued higher 
than in the early y^ars of the project. . ^ 

Table 3: Male and Female' Proportions among the Student 
Populations: 1979-1983 



7o 


7o 


7o 


% 


.7o 




7o 


7o 


. 7o 


7., 


4 


4 


12 


39 


33 


8 


6 


22 


■ 4^ 


48 


. 8 


6 


• 16 


14 


14 • 


2$ 


21 


29 


19 


17 


18 


11 


16 


11 


15 


•22 


11 


16 


14 


16 


29 


39 


14 




12 


.. 25 


38 


14 


5 


9 


18 


20 


14 




19 


•10 


12 = 


4 


7 


11 


23 ^ 




16 


8 




6 


12. 


2 


2 


3 


0 




10 


3 


'I 


0 


• 0 


0 


9 


5 







1979 1980 1981 1982 1983 


Sex 




% % % % % 


Male\ • 




12 . 19 16 18 18 


Female^^ 




88 81 ' 84 82 82 



Ethnicity^ changed a great deal in 1981 and some of that difference remained' in 
1982 and 1983. In all the earl^fer years, Mexican Acneric^ns had made up more 
than half. In the latter years, the nunber decreased, as did the percentage, 
while the number of Anglos and other Latin Americans increased. It should be 
noted, however, that some Mexican Americans t±iat speak little or no Spanish 
classified themselves in the "Anglo and other" category. (Table 4) 

, Table 4: Reported Ethnicity Frequencies : 1979-1983 




Ethnicity 


1979 1980 1981 1982 1983 

% ^ ^ % % 


Mexican American 


53 


55 


37 


43 


41 


Other Latin Americans 


0 


7 


8 


10 


11 


Black 1 


2 


0 


2- 


1 


"1 


Amferican Indian 


"0. 


0 


2 


2 


1 


Anglo and other 


45 


38 


52 


4^ 


46 



JC 
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The proportion £f the students that already held the bilingual endorsement grew 
very rapidly fran 1977 through 1980. In 1981, however, the percentage dropped 
dramatically from the previous high of 647o to^ 267o. Mahy of the 1981 students 
were tiew to the program and/ or were undergraduates , and had not yet had time 
to conplete tte certificate courses. In 1983, that perc^tage remained lew since 
many were seeking the ESL endorsement. 

Seven years of examining student characteristics has found inportant dif f erejices . 
The early years of being one of the first university programs to make the' certi- 
ficate available, attracted a large nuiiber of exjJerienced persons to the degree 
program. Many Mexican Mericans were, among that early group. later, Anglos and 
others were attracted; even, more of this group appeared ^^len the ESL endorsement 
program was- approved. Similarly, the emphasis on undergraduates reduced the 
proportions of both total and bilingual experience among the students ; the latter 
was reduced even further with the* ESL program. 

These changes, however, correspond to the reality of \^t,was happening in the 
districts, among students generally, and within the liiiyersity. East Texas 
State liiiversity and the ESEA Title VII project have been able to meet the cur- 
rent needs of t;he students and of education in the State of Texas. 
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STUDENT PERCEPTIONS OF THE SERVICES 

Many universities have begiin programs for bilingual education; some 
o£ them have experienced little or no growth. One o£ the problems 
has. been a 'r^S.tr ictive set o£ course offerings that did not appeal 
to the students. Still another has been offerings by professors 
who were unprepared in bilingual education or who continually dwelt 
"On philosophical issues or personal campaigns of. one sort or another 
but who did 'not progress to a high degree of technical teacher pre-^ 
paratio^.^ None of tTiese conditions has produced attractive prtograras 
to: a large number of students. * \ 

' - w ^ 

, ■ ' ' • ■ ' .*> • 

To help assure'that both the program and the courses met the stu- ' 
dents* needs, the East Texas State* University Title VII project set 
up a close monitoring system, utilizing both expert judgment about 
the courses and the way they were taught, and student perceptions 
of the program as a whole and its. parts. As each set of course ob- 
servations was* completed, ;oral and written interim reports were sub; 
mitted so that the project administrators had the opportunity to 
talk with the instructors, giving«.helpful suggestions for improve- 
ment. In addition,^ the observor offered private, individual coii- 
ferences to any professor that so requested, again to offer sugges- 
tions. Further, the students rated each course and the rating forms 
were sent to the evaluatbr. The results were summarized, sent to 
^ the administration, and offered to any professor that desired the , 
information on his specific course. ^ ^ 

The present document, because of the anonymity requirements, does 
not identify professors or courses; these wer.e discussed as they 
related to the Title VII project *s attempts to produce^ the best • 
possible environment for learning. Reiterating from the methodology 
^:^ection, the student evaluations were voluntary, thus some courses 
Veceived few ratings. Also, some courses iij rstudents * programs were 
not exclusively for bilingual education and^jone or ^only-a few stu-/ 
dents might be enrolled in them. This reduced the statistical in- 
*ferences that could be made from the ratings. The discussions in 
this chapter will be concerned principally, then, with those courses 
for which three or more forms Were returned. The narrative sugges- 
tions, however, were utilized for the entire range of courses in 
which the reporting students were enrolled.' ' * 



General Perceptions 

The students were asked to rate the general program in which they 
were enrolled plus their fluency in Spanish. In addition to one 
point in time assessments, their ratings were examined across the 
years they ^were enrolled, giving both a cross sectional and a longi- 
tudinal analysis of these two General elements. 

The first element, the degree design, was examined in the present 
report in two ways. ■ First, the ratings by all students- reporting 
.each year were compared across the laSt four years . Many in 1981 
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even more in 1982 wejfe just beginning their programs under the project and few 
chose to judge them at that point; in 1983, however, they had progressed far 
enough to feel conpetent to rate't±ie program: (See Table 5.) 

The mean rating given by those responding \^ greater X^ban the strong category. 
It \jas higher than had ever been Recorded previously. Ihe improvements in tiie^ 
degree design (Appendix A) were probably involved; cannents also 'suggested that 
a former advisor, no longer with the project, had sometimes 'Vnisled" than and 
they appreciated the higher quality in 1982-1983. ' I 

Table 5: Rating Frequencies and Calculated Conposite Means 
on Degree Etesign - 



• 1978 1979 19^0 1981 1982 1983 





% 


7o 


% 


% 


7o 


J 


Very strong- 


10 


•6 


18 


14 


16 


25 


Strong 


47 


53 


51 


41 


41 


51 


Fair 


39 


30 


27 


16 


8 


10 




■ 1 


2 


1 


2 


0 


-0 


Very ia^f 


1 


b 


• 0 


0 


0 


0- 


No res^iOTise 


2 


10 


3 


.27 


35 . 


12 


Cciiposite Ratixig^ 


' 3.62 3.72-3.88 -3.91 4.08*4.12'' 



* Very strong=5^ strong=4^ fair=3^ weal^j very weah=l; 
no response uas eliminated from the calculations for 
the composite ratings.^ . 

The 1983 rating was not statistically different from that of 1982 but it was 
(.001) \^hen conpared to 1978 and 1979. The'degree design is a conplicated. va- 
riable but the students saw improvement over the years. • ' 

Ihe influxxjf students seeking the ESL endorsement but not that of the bilingual 
credential ^s ccxiplicated the conparisons of increased Spanish fluency across 
the years '^i±)stantial increase^ had^been registered during 1981 and 1982 but 
the niany participants ^ot studying Spanish in 1^83 clouded the issue for 1983.. 
:MaLthecnatically, the proportion indicating progess declinced but it is unlikely 
, that this.w^ true for those enrolled in Spanish courses and in the bilingually 
taugiht methods courses. 

The nuniber of undergraduates and the BSL. teachers rxew to the program lowered the 
proportion of those ^o could jxadge the liaison services to the schools and 
teachers. .The mean rating, between. /air Zj/ and very effective, remained at the 
same level as for 1982. It has been quite stable across the years. Those who 
know the program rate it quite highly. 

Few evaluator observations of the liaison visits can be conducted during the mo- 
nitoring due to the press of time. It is necessary to rely heavily, then, on ^ 
the interviews with the participants. Their cocmmts r^e widely -in cciitent, 
depending upon the nature of the assistance that is furnished, but their qua- 
litative ji^gments are much like those in the ratings: it is a worthv^le pro- 
gram ccnponent. It is irrportant to note that almost all of than exoress the 
opinion that more liaison visits wbuld help them and their schools ii\ reach- 
ing the limited English speaking children. ' , • 

sbjci 
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Table 6: Frequencies and Cccrposite Ratings of the Liaison Services: 
■ 1979-1983 



Response Categories* 


1979 1980 1981 1982 1983 
% 7o 7o 70--^ 7c, 

fO to to fO #0 


Very effective 
Fairly effective 
Not effective 


16- 20 16 17 14 
13 27 4 10 8 
4 ^ 6 0 .0 0 


No response/Not observed* J= - 


67 47 80 73 78 




Conposite rating 


1.4 1.3 1.3 1.4 1.4 





* Very effeative=2, fairly effective=lj not effective^O; no response/ 
not observed excZuded from the , calculation of the composite rating. 

In ear li^ years, the evaliiation included the ccxisultant portion of the prtJject. 
Tlie general reduction of funds at the University has considerably reduced the 
micber of speakers diat can be brought in. The project continued to cooperate 
with other organizations on the canpus and in the Satellite Learning Center area > 
1:0 provide v^t it could. The coaponent was dropped from the new evaluation * 
form because of the scarcity of resources for its realization, 

$ ' * 

Overview of the Services ^ < 

The major services were rated at about fair ih the earlier years; those ratings- 
have inproved during tlie past four years or have remained stable. "The most im- 
portant increase in the ratings 'has been fof the degree design, ,.a vital element 
to students. Changing participant corposition, dvB to ESL students; was tliought 
as a potential- reduction about services *but the newer entrants that replied about 
the services answered Tiuch as the bilingual students did.. - 
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PERCEPTIONS OF THE INSTRUCTION 

, The East Texas State University Title VII. project has emphasized the 
improvement in the delivery o£ its services to the students. The 
provision o£ materials, professors experienced in bilingual educa- 
tion, and assistance to those professors was expected to create a 
teaching/le^irning environment that would maximize the; participant 
benefits from this most important portion of the program. ^ Greater 
learning by the students, who are the teachers and specialists in 
the districts, would then benefit the pupils in those districts by 
increasing their learning, ^ ^ . ^ 

University systems are such that a special project cannot demand 
, changes in t%e way the courses are taught.; it can only offer assis- 
tance and suggestions so that those who want^ to , improve, can- do so. , 
individual professors are jealous, of their courses , -and sometimes 
resist modifications, that, might make their work more acceptable to 
students, reasoning that their subject matter is more important 
than what the students think. Too, circumstances do not always per- , 
mit a University the i^eal choice for an instructor in a particular 
course. East Texas State University has continually worked towards 
the long range go£^l"of improved teaching, both ^by offering ass^is- 
tance and- by choosing the best personnel it can find. 

Some subj ects , however,, are less well received in and of themselves 
and these tend to receive l63s f dvorable^ evaluatioAS from students. 
Subjects* that are totally new to'^the students , oneS : that require an 
unusual amount of outside study, and those that are more theoreti- 
cal than practical are among the less^ favored materials. Addition- 
ally, not all students perceive the conduct of a course- alike>v. Va- 
riations in their perspectives, their preparation; and their inten- 
tions when they signed up for a course all coT\tribute to differen- ' 
tials in the ratings given.. . ' • 

Nevertheless, the University insiststhat student 'perceived infor- ' 
ijiatlon about the'xourses is a valujEtble input, to. the ' improvement of ' 
the project services. The " cqptmtotis experience' the evaluator 
with this program demonstrated t!feat such is the case. Each, year 
sevetal prof essors have requestecK^rivate 'information about their 
course ratings', have discussed the $^udent perceived deficiencies • 
and strengths with the evaluator, and have subsequently m'odif ied^'the 
offerings such that their ratings have improved. 

Two types of information were gathered about the courses: onfe was the 
ratings on* the courses and the instructional components , of them. .The 
ratings provided direct measurement for the evaluation and benchmarks 
against which the professors could strive for improvement . The se- 
cond type was suggestions from the students pn ho^ to improve the 
courses. These Vere important adjuncts to the scale values (very 
strong, strong, fair, weak, very weak) on a Likert scale of 1 to 5 
(a reversed' polarity) , which allpws for statistical analyses of the 
results. I'he suggestions for improvement and the general comments 
about courses are usually not quantified since their voluntary ' 
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inclusion does not necessai-ily indicate the number of students hold- 
ing that opinion. - . 



In a few instances, a comment or suggestion will be so pervasive 
that the proportion of students indicating it is provided, either 
because the number was, small and therefore might not represent the 
Ideas of the group, or vfhen the number was large and thus demonstra- 
ted a general perception. The anon^ity of the professors was guar- 
anteed and that sometimes caused comments to be deleted from the re- 
port since theit inclusion would point directly to one instructor 
When a suggestion was positive, posing no threat to the professor! 
It was 'incorporated even though identification might be^ possible. * 

Program Design 

Each student was asked to comment oh or offer suggestions about how 
the general design of the program could be enhanced. Across the 
four years, these have decreased considerably, apparently reflect- 
ing the higher positive ratings given the courses during that time. 

appeared that in. most cases, when students were satisfied 
with the courses they felt less inclined to write out general com- 
T^tfi^' Th^^ isriiot absolute, however, since two copditions in 1979- 
1980 caused them to include substantial narrative information and 
t±e positive conniaits have continued 'since then. f 

First, two l.ess than positive conditions were comraentfed on exten- 
sively. Over the years, but in lesser quantitieTs each year the 
stu'dents have expected that the professors wbuld-use -more Spanish 
in the conduct of 'the classes. As discussed in a previous section 
the amount of Spanish that could be used was in part dictated by 
the proficiency of. the professor 'and in part, that pf the students. 
The suggestions did note differences but still indicated ^'their own 
concerns for greater f.luency; in Spanish and the' recognition that 
Its utilization. in the classes could, heitp them improve." . , :• • - 

The second type of comment was that engendered by perceived improper 
.condu<?t of a' cq.urse. • The students might be generally satisfied with 
their program Vbut regard a particular course as needing improvement. 
While, some of these were discussed earlier, the most- important bi£te< 
are reiterated here for emQhasis: " 



Students expected that -Spaftii^^ dominant language ■ 

, m a Spanish,, course'r- th«y ,,o.b^^^^ one under- 

graduate course was taught tiriinarily in English.' '"' 

. Both Mexican. Americans an^ non-Mexican Americans" objected tt> 
disparaging remarks made alsout Mexican Ameri?lns^•4xld/or about 
their Spanish. " - ; 

. Criticisms about several undergraduate, nari-program;-cburses 
were frequent; the grading system,. was criticized iri some of 
the -courses.. ' ., ,: . * ■■ ; ' . ■■ ', 

. The graduate courses, especially, those on. Spanish,' enl.oyed 
very favorable comments . - • • /- -^^^ 
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These findings were relayed to the administration of the project and^ 
to those professors that requested private information on their own 
courses. The project and University adininistrations were aware of. 
most of these probl-ems and were seeking ways to^ alleviate them. At 
least one professor ihade a determined effort, to improve ^the delivery 
of the ^courses between the fall and -spring sessions and the spring 
comments showed some success in this regard. r ^ 

The posit ive comments , mentioned earlier.,^,far out weighed those that 
were less favorable* In fact, mpst coUrsfi^s received a considerable 
number of notes about the amount ofi'viea^xrig ^ the excellent informa- 
tion that^had been- imparted ^ and the methods used' in teaching them. 

Another kind of suggestion emanated from a 1981 course added to the 
program. All the students but one in that course took the. time to 
writei a substantial narrative about it, praising the professor, the''^ 
project, and the inclusion of the course in the design. As an ilJLus- 
tration of the strength- of the offering, the following e^cerpts^^.i-o^ 
^jhe comments are presented: 

;thq.s course should be a prerequisite , to' be takea before 
tfti^ othpt bilingual courses. . . ■ ; . 

[his course should be offered at thei-^begiyining of the 
: ^ Masters program. ^^"■'^'^v^ 

r learned more about writing and improving iny Spanish fluency 
> in this course than in any I have ever taken. 

■r^' ...is to be 'c^^^ for -the finest course ever presented 

in this or .ahy^^^^^^^^^^^ in which r^jjiave beeit enrolled. 

l^v Now I want, mprg .; a ^'yoXIowup course or ^puijses on Spanish gram- 

P; mar and coifnpps^ greatly • improve:;i;.has program. 

Tljese are especially^^^:^^^^^^ judgments* sijice the; students were by 

no means tallcing i^Kmxii%i ^^iii:&y course. Included in Jtheir iommentSv\ 
. were phrasers Such af 'V:.,>tou^^^ course ev-er. . . .hard' professor 
but knows her business and how to teach it...'- "worked harder on 
this^ course than all the rest combined." The only ,;^i[;egative comments, 
and those were still .tempered by praise for the (ib^rse and the pro- 
fessor, came from- students' who felt that their level of pr4fici§|icy 
in Spanish caused them some difficulties. 

: . Nearly every .student s that ^the course be offered very early 

; (or first) in th? program. It would appear to .the evaluatOr, how- 
ever, that some s.tHdy of the case should precede such a move. A 
good miahy of ,th(?:^ s^^^ in this course were hot very proficient in 

Spanish when . tHey;^.h^ work at East Texas St&te University. 

No doubt some^coul,d^Jfta^^ the course almost immediately but some 

would have ha.d many'- difficulties and perhaps not have leirned as much- 
as they did at; this .ia time. If there were enough students, the 
best might .be toi.ofter a section early to students very fluent in 
Spanis^h^ a^d then:'^ on for those that need to improve 

^•theira f iiiency ;;f : ; 
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In general; then, 'the prograoi design,* as. seen t±iroaj^ design and the 

conments regarding it, has shown a^steadily i^nproving. rating across the years. 
" " The incxeasfe for this year, according to the narratives /writtm by the students, 
was due. to .the revisions of the program, the addition continuance of setae 
courses thi^ felt 'to be xjnusually useful, and inproved-relatims in advising. 

Course Ratiiigs'^w.':/ ^ 

The nunber of CQurtes rated during the^'present and the! p^t-year^ was siibstanti- 
^ ally highfitr than in pre\7ious evaluations, priinarily b6qauise;:6f .the mcDber of un- 
. der graduates .; Siniilarly,, thes^ represented many in the early 

years ; that f actbt nad^ gieneralities about the overali ratiffes . tiie^jniiigless - since 
most students have scrae subject area the do not, enj.oy/br^\^ have 
difficulties. To allieviate this poteiitikl problan, the subjects by 
^ -areas to give a more laseful evaluation. ■ . ' r: .\ 

' ? Table 7 nnnraingMifa Tn|nTfmai-Ton for. the present and past y6a^ 

,?1y that the polarity 'i^reversed from niany, xxnnm scales: the best rating is t= 
'■ [':^^^ and 5=veryweak, thus the /smaller ' the nuniber, the better ''the students 

r; -^^: judged the courses in that subject .area\ • ■ • ' i 

Table 7: Ccraparative Overall Ratings by Students of the Courses Tsdcen . to Ful- 
fill their ^Degree Requirements: 1981-1982 and 1982-1983 



Course Areas : 


Undergt^duate . 
1982 1 I'i 1983 


Graduate 
^1982 1983 


No. of 
Reports 


Language : 










English 


1.85 ' '^1.33 




1.33 


19 


Spanish <: ■ 


• 3.33../;^ 2.06 


■■■'■1:22 


1.24 


41 


French . 


2.30 K :G.50 > 






5 


Linguistics \ - 


3.33 ijL.OO; 




1.33 


7 



Education : 
,;El<»nEntary 



2.50 



,1.97 



1.58 



18 ...^ 



Secondary ^ - 




,1.50 . '.-r ^' 




3 


Social Sciences: / ■\'^' 
History '\ 
Political Sciaice* ^s^. 
•Psychology' ^^^^^^-^^ajT^ 
Sociology- ; 


L.45" 
2.50 
1:78 , 
2.25 


3.00 




7 

. 4 
3 

7 i; 


Mathematics/S^«ce: ^ 

Mathematics Tpff 
Biology . vi>^'' 
Botany ^\ ' - ^ . 
Earth Seances . ■ / 


1.80 
1.50 

■ 1.00 


#■ ■ 

2.00.-- - 

1.75 

2.83 

1.00, 


4 — 


5 
3 

5 ; 



Computer Science 
Physical ' Education 



2. 75 



1,00 
-2.^5 t 



1 
5 





* The overall rating was' given by^ ihe students, an^ is not a mathematical mean 
of the other detailed rati? 
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Fa^subst^tive, changes were seeri between- 1^ arid^ lQR? iqqV • ' cj'. 

numbers of students reported on -their com-S ov^l?^? ^^^^^ sufficient. 
■ Severe probl^ have bSti notS SSS STSeD^Jf "^^^^^^P^^^- ' 
than one point gain toward the hiSS? StiS^w4^M^''''il^^^^^ 
gory i IS. notable . Uhdergraduatk fSuS SS'o f • ^ • strong, cate- ^ , 

- numbers reporting this^S^e' SllS rt^l^^^^^" also .dii$)roVed but the v 
.;.charige,swe?fe-iSiab^ S^^T- Nf^^^S^.^^s, the , 

V- remained; Vcaw^ partS^tS^ym ^ ' .^^l^stics,-. : 

hlshi ratings tha« for the pre- ' 

lowered rating had sevaTf^Xts^Si ^ '^J^^^J^ registered a . 
and science oJurses contimS^t^d S°^: S'"^' 5*°'^ matbanatics 
. .-across the two vears ■nJT^.cT:^- ?ub5fects isauld be fcomared 

^^^^^S^^tr' ?tudeM:^Wly left 
; general satisfaction with the co^se^Tis^Sble^Sr ^^t^*^ ^ 

v^^reg^stered on tl« w^^^te'spSiM ^oS^^I STSeJ^iS^Sr^S^" 

.g^g. SCO. ,^s! - ^^S=^ 

SrS3^^rtteSst'S;»'^^^^^^ pialletor '. 

■ttat the jrofessSr«S2d £ve S'bSS^t&S^^ °' ^^^m^-^ 
ence. nine elaborated on how that Ss^StS'^^^Sge' 

undergraduaSe-^es^fe^S^etaXjTStf^S^hTS?'^ ^ 
by the students as providlS^^Ssfced SoS»??S- '?°- ' ■ 

spciallsciences ,dispVe?^ylLl^1o^°™?M"«U^^^^^^ . ' 

'^t^i&'ff-tl^^lkt^^'''^r'^^^ ratings- for ^his ye^'W^ all 
sors to lnprove the oSrto ^^f^^^ md vorHns «ith the orofes- 

, areas sirS tlkylSre 2rS* oSS\?S^ ™ "J^ difficult, for Ttbst 

Title VII Prc-jit^VbTiSSdli^itf^^SuS^Lp^lJl^T-^^^^ , 
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THE POIIJCWUP SURVEY -' rC^-^^^^^ 

The East Texas State University ESEA Title VII Bilingual Program has carefully 
evaluated its inportant phases throughout its seven year life, obtaining the 
opinions and suggestions of students annually. These, in turn, have been cotrpu- 
terized to allow for ttends across the. years. The mass off data, considerably-- 
attenuated during the past tro years because of costs and utility for the pre- . 
• sent, have alleged many modifications in the operation of the program and, as ' 
seen in tiie earlier sections, a great deal of iinprovement . . Indeed, the annual 
evaluations in recent years have shown the program to be istrong in its component 
parts. 

Not content with always viewing present- time data, the project decided to conduct 
a followiq) survey, apart fran th^ regular annual evaluaticxi, that would allow the 
past students, as well as those xmjrrently- enrolled, to.eq^ress their opinions and 
give suggestions for still further ojuprovenient. The suggestions of past students 
were accorded ''greater merit since they were.no longer directly affiliated with 
the University and were aiploying vAiat they had learned there, or feeling the 
lack of learning, in their positions. ^ " 

TWo approaches were taken to the survey. First, the" program secretary mdefl&^^ 
to contact all tlfe previous students that had coqpleted one or nbre semestfejjk * ' 
under funding from the ESEA Title VTI project. The basic information on tji^ii: 
present:-occiq>^tions , \*iether ytilizing. bilingual skills or not, and their air- 
jrent address^. ' The secortd approach \hs that of mailing out a stirvey form to 
those forvwl:^d^n^ addresses could be verified; some, of course, had moved and left^ 
fio farim^ address and could not otherwise be located. This was especially 
true llj^ first three years of the project; inccnplete records also hanpered 
the se^£h for soriB former students. 

The. total possible former students was 161:'fdlr the ^period that could" be verified. 
However, 24 of these could not be locateidj^^eav^^ potential respondents ./^ 
suniner mailing, necessary mder the cir^ist^^ce?^^^ b^ always deficient for find- 
ing teachers , resiiLted in a re'tum of 50 *±ristft]fBents by the time this report was " 
written. Any additional forms obtained will be added into a later report. 

The instrunmt, presented in Appendix C, contained many similar elanents'^to that 
used for the annual evaluations. To allow for separate calculations of the -da- 
ta, present from past enrollment was contained as an introductory item. Exactly 
half was enrolled at the tiirie the survey was answ^ed. Their present/past d^er-. 
ience since enrollment, \^^ther the experience involved bilingual or ESL, was re-^ 
quested. The possession of bachelor, masters, or doctorate di^^rees, \*iether- the^jr^ 
were obtained at East Texas State University or else^N^ere , . gnd a category forvr - -' 
those that took only a few courses ^ the Ifciiversity checked that portion of the 
, J educational e5q)erience. Simi^larly, possession of the bilingual and other certi- 
ficates and where they were obtained furnished valuable informati<5n. 

An opinionnaire section followe'iL Peeking the participants* judgments about ^the 
several s\±)ject areas in their sthdies at the University, as- wel^ as their en- 
dorsement/certificate and degree programs . Finally, tttfey were asked to rate 
their East Texas State -University program as a whole. Equally important with 
the ratings, the respondents were asked to add any cgmments about each opinion 
r<con[ponent, explaifiing their ratings oi? offering .suggestion^:* 

The forms were forwarded to ,tihe evaluator, who analyzed the answers and prepated 
^ • ■ DEVELOPMENT Associates, inc. — = — 
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the -present renpftr The provisional natjire of the present infonflation must be 
stressed since more' forms will be returned 'later/ ' . 



Characteristics of the.' Survey StiidesOT^ , ' 

The direct contact survey by the program Secretary produted both primary, (discus^ 
«,,sions with the former fstudent) and secondary j^informaticd from otherysources) 
• data on them. Slightly over 897o was dnployed'in a biljiigUal settin/, teaching ' . 
o^rih'.some,ot^^ the bilingual populations of their: smcoj^, dis- 

trlc^ls,. arid't^ ^ Some /of •course, had been promoted to non-cl^iw^ 

positions but in any event, they were still concerned with ciiildrenVpe^kihg lan- 
guages other than Eiiglish. The East Texas State University- has, the\ admirably 
served its principal purpose of adding to the resources available \o limited and 
non-English spealdng children. ;^ # . 

The remaining. 10.8% was in a variety of positions, mostly those of teaching in 
"a Regular, full English classroom: 1 Only three persons were in non-education po^ 
siticns, all in business requiring no Spanish in their opinion.^:' 

The mail- -form respond^ts, as noted previoiasly, contained half currer^tly enrolled. 
Marly of these, howBvet';;^*^re aXso teaching or working in other positions at the 
same time. The declafea occupations (Table 8), shewed only 167o to be full time^ 
students. Sixty percent of the respondents was in .ttfer- teaching profession; the 
% others were in related fields. 



Table 8: Occupations of the Responding Survey Students as of Siimner 1983* 

Oco^jatipn , Percent Occupation Percent 

Elementary teacher Instructional specialist 2 

Secondary teacher \, 10 Education writer ' 2 

Aide !Z Curriculum coordinator . 2 

•Volunteer . 2 Business 2 

Substitute ^* 2 Bilingual secretary -'2 

Adult ESL ; ;r ( 2 Student ' 16 

One person did^'r^ot': respond M this question. 

Of tilose '>*io were not 'teaching at the time of the survey, 147o had taught since 
cccr^S^te^iing their studies at the University. Totalling those now teaching with 
thos6 that had in the p^t;-.^at least some of that experience was bilingual, 
747o, and/ or ESL. A87o. The undergraduate students, some* of whom had taught 
and some had nou, coctplicated the separation of them from the results of this 
question.* - . 

Eighty- eight percent: of the respcndents had already achieved the bachelors degree; 
twerity-six percent had obtained it from East Texas State University, ..The large 
number of masters students, plus those from other Federation universities who 
came in 'for special courses or the certificate program, accounted for the others. 
This is errphasized in the percentage with jnasters degrees - 387o - and with 63% ^ 
from this Universrity. Only two doctoral students replied;* one had received the 
degree from East 'Texas State University and the other elsewhere. 

.^Scme fourteen percent noted they had taken *only a few courses at' East Texas 
.State University, mostly these were Federation students. 
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. 'A major goal of many students ixi the program is the acquisition of the bilingual 
endorseanent to the elementary teaching certificate. Three avenues ^^e open to 
them: 1. pgmplete all the requirements at East Texas State University and be re- 
coDonamded that instil 2. .^ply directly to the Texas Educaticn Agency, 
receive a d^icieney plan if they lacked any of the "requirements, conplete thpse 
at a university,, and then, submit the transcripts to the Agency; 3. participate 
Ih a district preparation program and take courses at a university, and be re- 
ccxrmended by the district ^^len the requirements were mef. ^ Forty- four percent of 

^ the respondents had alreacfy achieved th<at goal ; 407o had done so directly thrbugji 
the Title VII program, the others taking some courses at East Texas State Univer- 
sity and si±BQitting the transcripts to- districts or directly to the Agency. 

Students ^lo planned their degree programs accordingily, or ^who had the necessary 
transfer c6^%es, were able to obtain other certificates, or endorseoHnts as veil. 
Those attained by the respondents included: elenmtary (7), kindergarten (4), 
supervisor (3), special education (2) , mentally retarded (1), Spanish (2), and 
ESL (2), The latter will, of course, increase substantially during the next 
years. 

"In general, then, the respondents represented the program participants for the 
years encorpassed. Obviously, the responses from the earlier years were few; 
their changes of re^dence made contacting them more difficult . Ihe conibina- 
tion pf undergradioate and graduate students, the different degree and certifi- 
cate programs, and the ccnditions of 'the bilingual educatiai programs in the 
districts were ^reflected appropriately among the^ Title VII participants. * 

Course Groupings Judgments . ^ ' 

As not^ at the beginning of the sxxrvey section, it was expected that those who 
had conpleted their work at the Itiiversity ancf \^le in the profession had' some 
opportunities to judge the program eocnponmts more, objectively, might rate their ' 
courses dhd degree designs differently than those still in school. That was 
true, however, in only one ca6e; the graduate students no longer^ in school judged 
the* Spanish courses even higher than did those now enrolled.; The mean ratings 
for all other program elements were not significantly different when separated 
by 'former and present students . • (See Special Note to Table 9.)' 

Table 9: Mean Ratings of the Survey Respondents on the Prograip Course Groupings, 



Course Grouping 


Mean 


Course Grouping Mean 


Spanish* 


4.15 


ESL methods 4.03 


English 


3.77 


^her language methods -* 3.73 


Social studies 


3.77 


\Social/multicultural methods 4.30 


Mathematics/ scimce 


3.A8 


'^^thods for other subjects 3.88 


Bilingual , methods 


^4.11 



^ T!he mean for former graduate students was 4.87; undergraduate students^ whe- 
ther present or past ^ was 3.46. ^ ^ 

SPECIAL NOTE: In the seoticrm of i^e artmaX evaluation, the ratiwj icaZe dos xk 
reverse polarity witfi l==^^iy strong cmi 5=very b)eah. In the surve:/, 5=very 
strong J 4=strcng, 2=fair, 2=ueah, livery weak. The* change was intentionally made 
to avoid routine replies. No respondent confused the scales. 
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Spanish enjoyed the highest rating of any .course grouping, one- third higher than' 
strong. There were also more conments appended to this item than any other. The 
majority of these were suninary statenients about the excellence of the courses. 
AIJ. the other directly ptositive notations cdmieoded the graduate Spanish ^profes- 
sor for her lanowledge, methods, gnd ability to motivate the students. gra- 
te students recoDinended>more practice and instruction on writing Spanish, and 
two. requested more cdrurses on the language. Five undergraduate students repeated 
the cooplaints that have been nearly constant through the years : Spanish courses 
taught in English and one professor that ridicules Mexican Americans' Spanish. 

Ihe social studiesfnulticultural methods courses received a rating alinost as high 
' as Spanish, 4.30, again a third above the strong rating. F©^ conments were re- ^ 
gistered: one conmended a workshop on multicultural methods as the best ever ta- 
ken; two suggested that more courses be taught on this subject and that how to 
teach awareness of multicultural strengths would help phe teachers. 

The bilingual methods courses also received a better than strong jiadgpent, 4,11. 
Sane general statenients about the utility and relevancy of the courses were in- 
cluded and one praised the staff highly. The only cotr^laint was that thp respon- 
dent felt that more writing methods should have been included. 

The ESL methp^ courses aTso merited a strong rating, 4^03, and the second lar- 
gest nuiiber^'of ccran^ts within this group; all from graduate students. The 
necessity and relevance of the subject were observed by 'eight respondents^ Four 
made general positive statemaits about the work. One noted that the opportunity 
to find out what other teachjbrs were doing was of special practicality. TW6 felt 
tliatt the professors needed more elanentary classroom experience and another noted 
that the information was ifostly for elementary teachers and dwelt little on the 
teaching of ESL ir^ secondary schools. > ' . • 

All the other subject groupings 3^e jiodged between /air and strong. While only 
a few weak and no very weak ratirtgs wer^ marked in thi^ survey, almost all of 
the^weak judgments were given to this groi^). That is, there was a wide variation 
in the ratings, not unexpected since many professors were involved across the 
years. Too, few coraijents were appended to the items covering- these course group- 
ings; these*^ tended to be specific statements, mostly negative, about particular 
professors. 5)^^^^^ 

In any survey, of this t^p^ there is always the concern that those feeling" more 
positiYe"i:s»<?ard the program and courses would be more likely to cotrplete the 
form and reWm it. A conparison of the course ratings with those of previous , 
years suggests that this did not happen. Undergraduates judged the coursfes al- 
most QKactly as they had each of the past three years. Graduate student ratings 
tended to be more positive than previously but their time •away from the Univer- 
sity probably explains that differential. When enough coainents were included, 
such as was the case for Spanish, English, 'bilingjjal and ESL methods, they sup- , 
ported the ratings given. No systematic biases could be ascertained from the 
examination of ^the survey with the annual ratings . ^ * -^'f 

Program .Judgjioits 

Three general program ratings were sought in the survey, two specific to the pro- 
ject (endorsement/certificate and degree designs) -and one probed the overall East 
Texas State University exp*erience. Almost no comments were appended to the ra- 
tyings of the endorsement/certificate programs but the general LMversity exper- 
ience item brought a host of cotntients, both specific to the University and 
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to the courses, professors, and other program ccniponents. A f ew cotrmented on the 
degree design. 

The elj^dorsanent/certificate programs received an almost exactly strong rating, 
3.93, and there was little variation among the respondents; an almost equal ndm- ^ 
ber judged them fair, ^strong, and very strong. Since there were no ccninents, no 
analysis of the differences could be made. , 

The degree design was giverwr higher rating, 4.08, just. above strorig.. The few ^ 
cotimq;nts indicated dflfc the students involved in transfers to other 'universities 
had ejcperienced seme difficulty. One conplained generally about the Federation 
iregulaticns , another said that acceptable courses to other Federation universi- 
ties should-^ more clearly marked (one course did not transfer). The favorable/ 
conments centered on the excellent advice that had been given^ - •! J 

The general East Texas State Uiiversity experience judgnent was strong, ^.09, in- 
dicating a considerable satisfaction. ' IJd differs was found between the ratings 
of former and present students-r The positive' .qormm the availability of 

piTofessors for conferences,' uie quality of 't±iat: advice, and that the University': 
takes an interest in, cares' about, students. Five also made specific' refereiice / 
to the bilingual program staff as very helpful to students. Two noted that theyr,^ 
had .attended othet universities and that the-East Texas State liiiversity exoeri- 
ence. Was the most rewarding of any. Only two negative context cotiments vTere in- 
clioded: sope professors are prejudiced against Mexican Americans, and that ixi; ' . 
some curriculun courses, there is too mL4ch busy work and not diou^h content.^" The 
preponderance of cccrnendatiqns for the Universi^ experience 'was -^^txci^ 
for the IftiiV^ity and for the Title VII projeA . - C . ■ " : * ' ]' ^ 

The sury^y foiniT^^^ designed to be fold4i/va2^^°?ailedr .'freei of .charge ; b^dc to^;tHe>: 
program' off iqe. That procedure left one t^iirii of the tack i^thcmt itens'fdr tfe 
respondents; Nevertheless, 21 (427o),:JLJtilize^ the^space to add other connents. ' 
Son>e o& these w^e reiterations of A^t had been said about the courses or the ^ 
program: hi^ praise for the graduate Spanish course and professor, accessibili- 
ty of the professors and program staff, and special ccomendations for scene other 
professors. Seven ccninents assessed the i^se of Spanish in the methods courses 
as very inportant to becoming truly bilingual; one noted her acquisition of pro- 
fessional vocabulary from that component. 

Five^ participants utilized the space to make suggestions about the survey instru- 
ment. •Four noted that some of the course groi^ings encompassed many courses in 
many departments, taught by many professors, and that the \ariation among them 
made it difficult to arrive at a rating. Social studies was given as an example 
in which onte participant stated he would have rated some specific courses very 
weak and others very strong^ thus he had to settle on a fair rating, which thus 
masked the reality of the situation. No doubt others experienced the same diffi- 
culty even though they did not express it as directly. 

Four former students utilized nhe space to compliment the Title^VII Bilingual 
Studies program for condiacting ihe survey. All^four^.xioted they^had studied at 
other institutions and had never been asked to make judgments about thOT./- They 

• felt thet survey was an indication of the iiroject and University- concern for its 
students-. ' Each also expressed an interest in knowing about the results"; since 

•r the surveys were anonymous, conrnuniqating directly with than is hot possi- 
ble. An announcement about where and when interested, persons might view the 
results would.be appropriate.' \ ' - 
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The 1982-1983 report on the external evaluation of the East. Texas State Universi- 
ty ESEA Title VII Bilingual Program coiprises two distinct sections : 

1. "the annual external evaluation; " ' ^ 

2. a isuryey of present and former participants. _ ' 

The maj or portion of this document is devoted . to the annual evaluation .but that = 
does not diminish the inpor t ance of the participant survey, vjhich although pro- 
' visional pending the receipt of more . survey forms, adds a valuable element via 
a iSTlowup to former students. " - 

Sunmary of the 1982-1983 Ev&luation. ^ 

The 1982-1983 ESEA Title VII Bilingual^ogram at East Texas State IMiversity, 
as in most past years, operated on funds from the University, the US Department 
of Education, and some special monies for specific courses from the Texas Educa- 
tion Agency. The increased emphasis on the xmdergraduate level, begun last year, 
was continued but inany masters , some specialist md doctoral participants were 
ir^cluded. * 

The program' s goals sought the enhancement of learing and educational opportuni- , 
ties for all children; they specifically were aimed at those" with limited Eng- 
lish proficiency. The means to those ends were the preparation of high quality ' 
bilingual and ESL teachers, specialists in those subjects and the s\:pport fields, 
*arid administrators capable of managing such programs. Measurable objectives 
were stated for the project and this external, evaluation, together with the re- 
ports from internal monitoring, were designed to assure the appropriate provision 
of the .services to the participants. It was e:q>ected that success in the pro- 
ject's objectives would aid in iiiproved learning by the Uiiversity students and 
then transmitted intQ bett^ teaching of the children in the service area, that 
of North Texas, and thus contribute to progress across the nation,' 

-I- The evaluation was corrprised of both formative and surmative aspects to fmmsh 

inrnediate feedback to the administration while modifications could still be ef- 
fected, and subsequently, an overall assessment of the conduct and the results 
of the project's year. Document reviews, interviews, observations, question- 
naires, and opinionnaires were the principal methods utilized to obtain the data. 
Activities on the Cfanmerce canpus and at the Satellite Learning Centea: in the 
Dallas area were monitoted twice during the year by the external 'evaluator.. 

The- proj ect began in cooperatioa with the Dallas schools but since progressed 
to ten others. Cooperation with other, imiversities , with education service cen- 
ters, and dissemination and assessment centers was active. Unusually strong in- 
"teractions were chronicled with the Texas Education Agency. Internally, the pro- 
ject works well with the departments and colleges; a carrpus wide committee is ' ' 
/. , active in advising the direction of the -activities. Major changes among the* 
» liiiversity administrative personnel did not diminish the thrust or acceptance ' 
of the program. 
. . /f ■ 

Courses are offered in several settings for the convenience of the students and- 
to enhance-^ the practicality of the offerings: the home canpus, the Satellite 
. • Learning Center, and in cooperating school districts. The main canpus library 

— • • • 
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has an inpressive holding ^of bilingual and related subject materials for stucfy; 
the Satellite Learning Center has many of the most used materi^s. Professors 
transpoit: large amounts of materials with them when they teach"^ in other sites , 
thus facilitating the study of the participants in those places. The adminis- 
tra-tibn was consoHdated position this year, and although it pla- 

ces^'a. heavy burden on thai professor, the "work was acconplished effectively. 

East Tepcas State University demonstrated its continuing ccnniitinent to the project 
through furnishing the salaries of most of ^the professors, part of that of the 
administrator, and pro\d-ding adequate office space. All of the professors but ^ 
one were on peirmanent status and* that one wasi promoted this year; all aspects 
of institutionalization were uniasually strong. The faculty and students both 
demonstrated increased protessicnalization efforts during the year, again a con- 
tinuation of their strong showing previously: 

' i j ■ ■ • 

^The major cociponent of tbej project, the instruction of the students , was rated 
high by the obieryor ahd;^b tij^ participants. Only a few eourses were still po- 
sing. probla:ns.M last year and was conprised entire- 
ly of undiergt^aduate o^ G&raduatfe courses generally, Spanish, and methods 
courses erlj^qy^ It was notable that the nuriber. of elements 
in ',th^u:o\jr$es t^^^ was>. judged weSk- ' diinrf nished to only a half dozen replies. The 
instriigtim very positive part^pf ^thQ TjLtle VII project seirvices. ^ . 

. The degree and endorsement/certificate plans-^and processes were also judged/in 
the strong category by the respondents. This 'did not differ between graduate 
and undergraduate students. was praised as having inproved during the 

year , reflecting favorably ^^jrTthe director and the staff that assists with that 
phase of the work. ; !^i^. 4 ' > \^ " ■ 

Wherv-fhcl982-1983 results ,were' compared with previous years, two kinds of find- 
ings were^^fVident. The iii^rov^ney^ts in the courses registered last year cdfltin- 
ued strong. : These have! enjoye<k jp^ since the beginning and now 

are veory positive. The^dfegree^jlsign also has* improved substantially from the.;,. 
^ earliest years, 1976; ^(^197^7 . ^'Jh^ deg^ program was still being modified at^,^;^ 
that time, and chari^s^ are stlilll>^^ .and apparently .those have be^ ^" 

salutory in thej^^ll^of ^ ^ ^ 

'^ '^' vj^-^^ Followup Survey 

The East Texas Ststt^^^t^i^^ project, not content with its annual 
evaluations, decid^P^^^t^ survey of former participants this ' 
^year. First, direct: [jci^ as many as possible, verifying ad- ' 
dresses and current ipbci^ during the simmer a survey form was . 
mailed to them. ' The*/ij:i:^^ similar to that of the annual evalu- 
ations but sij[iinarizedr*jl^ categ053.es. The report is, at 
this time, provisioni^l^^si^l^ elapsed for the returns. Neverthec 
less, fifty had repliea^a^: ^^^^^ -of them showed good representation 
for the most recent fiv^^ye^i^^J^njt previous to that time,, probably 
diae to changes of re3±dsacie^::'^y-\ 

The judgments about the £ol3^qj^^ was strong or higher: Spanish, 

bilingual methods , ESL mefel^ids;.^^ methods . Former 
students differed from itfe's^fc'\St\ie)^^g 'i^ly \in that they accorded an even higher 

rating for the graduate^ Sp^oiiifefe on the ratings were requested 
and almost all of them w^e negative contents were couched 
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in terms of suggestions for inprovanertt. A few voiced substantive cocDplaints 
about specific courses or professors; these were the same as Had been regis- 
tered across the -years. " ^ * 

The* degree process ^^s accorded h strong tating; most of the ccximents praised 
the advising. The endorsemait/certificate process \;ias given a slightly lower 
rating, with the respondents almost equally divided among fair, strong, and very 
Strang judgments. .Very few connents were sypplied^and...thos^ primarily dealt witii 
transfer problans to and from otiier -universities in the Federation. 

'A final iton probed judgments about the overall East Texas State University ex- 
perience, That, too, was assigned a strong rating. Many conmerits were written 
on this item, chiefly dealing with the interest in, and caring about, the stu- 
dents on the canpus. Many included the project specifically in those favorable 
replies. 

A space had intentionally been left blank on the fc0r to protect the replies from 
inspection by others during tiie mailing. Maiy students used tiiat space to rein- 
force \hat had been said previously with the majority reiterating praise for the 
graduate Spanish courses and the professor. Some other professors and the advis- 
ing also drew repeated -favorable accomts. . Four Students that had attended other 
institutions lauded the followup survey effort, noting it as .continued evidence 
of East Texas State diversity and the ESEA Title Vll Bilingual Program' Interest, 
in students and the results of the project wDrk. 
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REVISEDf-^PROGRAM OF STUDTI-S 19^24.83 



/ 



The courses" below ;are approved for funaing during 1982-83 and'- 
represent modifications aimed at meeting state endorsement requirement 
In bilingual fei^jcatlon and English as a Second Language. -. ? 

I . • " , V ^ 

M.Ed. Core Prb^rnm 

Sik courses from:" (These consmute the major) ?■ . • 

El. Ed. 595 Research Literature and Techniques ^ \ 

El.Ed. 501 Language Acquisition and Development in Early Childhood 
El. Ed. 502 Foundations in Communications Skills for Bilingual ' 
• Students: Reading, Listening, Speaking and Writing' 

El.Ed. 503 Foundation Skills for Bilingual Teaching of Mathe- 

* ■ ■ 

matics. Science, and Social Studies 

El.Ed. 64^ Teaching the Bilingual-Blcul Lural Child 

or / 

El.Ed. 62A Children of Minority Cultures 

9r . ; 

• El.Ed. 625 Teaching Children of Minority Cultures-Nursery through . 

^ Primary ' ^ . 

El.Ed. 52i Language ARts Curriculum for Grades One through Eicht 
or * " 



■RDG, 



or 



522 Readihg in tlie Elementary School 



RD,G. ^56 DevelopTnenta] Reading 

or 
RDG. 



!»25 Teaching Reading Comorehension 
El.,Ed.;i29 Workshop in Elementary Education: English as n''5ccond 

Language Methods and Materials 
El.Ed. |29 Workshop in Elementary Education: -Methods and n.-iferial:s 
. for Multicultural Awareness ' 



46 



50 



BILINGUAL EOUC.VTION ENDORSE^^IENT 



Cout3($' requirements 
12 serifester hours: 



ELED/Spi - Language Acquisition and Development in Early 
• Childhood 



ELED'502 - Foundations in CotouiiiGations Skills for Bilingual 
Students: Reading, Listening, Speaking and Writing" 



ELED 503 - Foujidatiah Skills for B i I iiigu^t.">^achihg of Mathe- 
. malWLjjarj. Science, and Social Studies 



FLL 511 - Teaching-: a Second Language ; v. * 
Other requirements 



1. Bachelors 's. degree 



2. Valid Texas teacher certificate 

3. Oral proficiency: Language iProf Iclenc/ Interview (LPI); 
Level 3 . 

4. Written_proficiency: College Levei Examination Program 
(CLEP) - Score - 50 ' 

5. ' One year successful classrooov leaching experience in an 

organized approved bilingual educ^ation^ program. 



■■yr ■ ' ■ ■ ■ . ■• .... ... 

, , Interdisciplinary Pro^^ram : . ;> 

'* • * ' • ' ■ . " ■ „■ ■ 

• ' * ■ . •• ■: ■■ ; 

Six ..Courses f rom: . (These const! t«t# nij-nor qr courses) 

■ . Bilingual Program for Element-fry Teachers : ' . 

' SPA 505 Children's Literature in Spanish y'/; 

SPA 555 Studies in iiterarv Movements ; Mexican American V, 
^ ■ (Chicano) Literature 

ENG. 557 Teaching English as a Second^ U ' 

ENG-558 Sbciolinguistics " -'' v; : • ■ ' • 

,,.;ENC 5 55A Central; tl^igul St ^ ■ y. ; 

EKG 556 Comparative Linguistics * ' > ■ 

^SOC/ANTH 553 -American Subcultural Groups' 
- or ANTH 547 Culture In Edu.catJpo 

FLL 511 Teaching a Second Language 

ENG 597 Special Topics in Engl ish: PsycfK^'l iq^^^^ . 

FLL .515 Seminar on Cross-Oil tural AsfeJ^tsi of Rilingualism 

i - ' ■ ■ . . ' 

*SPA 502^_,Survlval Spanish for Sclioql; ;ParSonne 1 

*pA 50S:^Practlcal Spanish for Eilitn^Ual Situations 

*SPA 504 Advanced Spanish foK Bil inrvfej Si tuatlons 



*Any or. all of these may be funded, but cy^l^ >ne can be counted 
> coward the Master's Pegree in Eiemefti&ry Wuaation ^' , .. ■ 
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■'■V . •■ ■i'-'v-N.^' ■ ■ • . , • • 

. EAST TEXAS STATE , ' . / 

Instxixitional Evaiuati^ . • 

Ihcjergraduate , • , Post Masters , Dpctoral . 

!• Present Ckxupatimt^'V- '^^ • . ' V . ' ^ \ 

Teacher, grades 1-3 ' ; Achrinlstrator v Cfeher, please specify/. *' 

Teacher, grades 4-6 ' ' Aide " / . . - 

Teacher, grades 7-12 ^Student ■ " ^ . 

2. Total Tqachiiig Experience: ' :': ' ^' ' 

None ^ ; ' 3-5 years ^ ; ; 

"•'*•> . • ■ ' ■ . ■ " ■ «» 

' ; V Less than 9,ipp. 6-10 years . : / ' ' ' . 

1-2 years 11 oirinore; " * ^ 

3..'.Total Bilingijial eaching Experience: V . ' v 

■ ' . • .^None ■ ■ ■' ■" ■ ;.. 3-5.years " 

* , . :^^1j^s tiiari 9 nb^/ V v ^ 6^34p y<^ars ^ ^ - . > ^^^/ /^ • - 
-. ^^ l-i^yiears \; ' ^ ^ \ - ■ ' ' ^ 
/■•■■•4.;;Male_^Ftec^ , . , . 

5v Ethnicity : Mpyi can American Black , . Ab&Iq * , Other (specijfy) :. < V.-N-^ . . 
- ..6.; p^^^^ bilipgual education endorsecopnt? Yes , No . " \ 

• 7/: If yes/ -was the mddrs^mm^ obtained through: ETSU , district , other uni^ ; , 
versity . ^^>v-:.::'; ;,^^ 

8. "I am receive Title VII ' ^ . ^ / ; 

' :>-I ani paying ny cwn fees. y-V / ^ - . 

*> I am receiving. other thari Title VII funding. ^ s.; - : / / : ' ' • -"^ 

WHAT SUGGESTIONS DO YOU HAVE FOR IMPROVING THE KJIIJCWING? (Use^ bade- ' if neet^pd.) 

1/ Language program ' ■ . . ^ ' . ; • * . 

^\ ■ ' , ■ ^ ' . 

2. Culture program , - ' ' . . 

3. ^Teaching methodologies _ 7 / ' \ .: \ . '. 
Research"-'. , y . '■'[■y^-'-" . , 

' 5.^ I^ your degree program as .a tell -at;. 

. pcuiit;-lpw" would- you rate it?-'; ..y';. V.-; v; , . ^ 

very weak, _weak, _fair., v^^stK^ "y^^'^-'^j^' '\■■'^'■ 

;^.cqritinueci.i^::::^r. • ' ^- ' ^ 

U f' . - ■ . ■ • . ■ • ■ ^ . 
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6. How wouia you rate your fliomcy in Spanish at tiii? point in' the program? 

_yery fluent, _fairly fluent, _know some Spanish, _lQl5w ne^ly no Span^ 

• ' ft* • ' * 
How would you rate your writing in Spanish? 

flxoent, _f airly, flueftt, _can write some, _can write very little. 

7. How woui(|you rate the effectiveness of the liaison program (school visits) 
in helpiiig^^you? * 

' VBify effective, . f airly effective, not effective, ' not observed *V 

CTBCLE THE APPROPSIATE NUMBER TO DTOICAIE YOIR OF THE 

COMPCMl^rS OF EACH OF YOUR COURSES ' (please request a separate sheet * for each) : 

1 '2 ' 3 4 5 . 
* very -strong fair, we^ . very 

. strong . ^ . . weak 

» ' ■ - .* ' ■ , • . ' 

1. How would you rate the* dov^Bge 
of the subject matter,? , V 

2/ Hew wovild you . rate the methods 
; usfed iii tea'phing the coiirse? 

,3. Haef closely were the; tests related , 
tb thiS iiaterials covered? 

4. In so far as you can tell at this ^ 
point , how would yoii rate the grad- 
' . JiJg system used in this coxarse? 

^ 5. How Would ^ou^ rate ydur learn- 
• *.iig in^^^t^ (iours^? 

Taldng all factors into coisi- , 
dotation,! woiiLd'your rat- 
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ETSU STUDENT SURVEY 



•Thank you. Dr. Alonzo Sosa, Coordinator ^cA, St* c Sc^a 

'•' ~~ — ' J— 

.'general 'INFOIS'S^Tta^: ' ' • . ■ • 

t - • / ■'■ ■ • ' ' ' ' ' : * ■■ 

l.a. I am currently taJiing one or nore courses at ^ ETSU. ' Yes "No ' * 

b. I am QOirrently taking; one of . more courses at ^o'ther univlrsTty-. ' Yes* No- • 

... 2. a. V-Jhat'is your currejit' occupation?' Td^cher: Elanentary - Seconcaarv j 'Acrvtnist*- 

K, ■ tor (specify): \ f o ther (soecif^; . - -^s^ ^ 

r^:- b. If: vou are not. a tjisacher hew, did you teach after leaving 'ETSU? Yes ' No ' 

c. If you taught, dici you .teach in a bilingual program? Yes No * — — 
Did you teaqh. ESL or a similar prograrrt? Yes No_ "'■ ~ — ' ' .• * 

3. Academic training achiever: . 

■ ■■■ ■• 

_ a. Bachelors degree: Yes_No_.,(b) If yes, at ETSU: ot another, universitv? 

c. Ma-sters degree: Yes_No_; (d) If yes, at ETSUPjor-anotheTmiversity?" 

V- e. Doctoral degree:- Yes_No_; . (f) if yes, at ETSU?_or another .-uuivers 

g- .I:,only took a few courses at ETSU rather than a degree or certificate — 
■;v^ program / >■ 
'■ • ■ ■ i' ■ ' 

4. a. Do you hold the bilingual endorserient? Yes ko 

. % Did you qualify for it at, ETSU? ^or-at anotheF^ln^^ 

c.'.;|f you obtained any other certificate or endorsan^^^ 2ISU~please 
•list it (them) ; . V- 

SV?JLUATia\^ IKTORMATICW: ^ , . - . ' ■ , 

* > ■ . . . ■ (». 

?lease answer -the follCTving, questions by circling a number on the -scale that 

cest aescribes your judgeinent about the progra-n .coroonents listed: 1-vexy weak 

.2=^eak, 3=rair, 4=strong, S^^ery strong, 6=didnot partiicipatite/ddn • t kno^./does not 

apply. Please use the ccrmertt line for exceotions or other ^cial ideas 

you want to ccrrrunicate. . " • ■ . . 

♦ . 

'5. a. Spanish C5D-a:se(s) ' , ' • 1. p ^ c c» 

by CoBTtient f , , ■ . ' ' - ■ 1- J 4 5.6 _ 

6. a. ^nalish course (s) ' ] : — ^ . ^ -, . .- ^ ' "* 

■ b. 'COTTTien t ■ ' . 

7. a.' Social studies/history course (s) ^ ' ~" r> f c c 

b. CorrTent ■ . ' •■ ■ . i ^ J 4 b 5. 

8'. a.. Ma tj;i/ science course (s) '. ~ '. '■ ^ — ^ ^ Z c g ^ 

b. ■ Ccmnen f , • , . . . ' . ^ ' "■ ""^ i ^ J « b b 

5 . a. Bilingual methods course (s) • ' I ' ' " i ? o / c g 

•■ • • b. Ccnrnent " . . ; V'. ^ . ^ * , 

10. a: other language arts methods course (s) '■ ' '' — ^ ' 2 3 4 5 6 

■b. Ccm7)en'& , • • 

11.. a. ESL nethods course (s) ' ~~i ' * — * — i -> ^ . c ^ 

b. Ccrmsnt ' ' 1 2 3 . 5.6 



The East IN-xas State University 'Bilingual Studi(?s orogrflm is conducting this 
_soll<^'u? survey to obtain inf oxroation about its academic program and how it 
can 'be Liproved. ^We wDuld . appreciate your replies to these few question^ as 
^ a part of that effort. Please feel free to add any suggestions that will helb' 



the pro6ra-n. ^ ' "^^^ """^'.•JC-. 

4 ' # • 



* ff"''^'^' Studies/multicultural methods course (s) 

V/ ' , > ^ - SI- N"-' ''si^' 



1 2 3 4.5 6 



13.a.^CQurse. (s') on niethods for qther ^'objects • 



1 2 3 4 5 6 



1.*^ . 14WB. ?our eftdorsener^/aertificate program as a u-hole 



1 2 3 4 5 6 



15'. a, Youf^ degree psogrftm as a whole 
• ■ ' *B." Conroent' 



1 2 3 4 5 6 



16.-^. fhinking^^ibc*:. your ETSU pr6gram as a whole, including' advisirtcj', acdemics, and 
C ^sistence, j^ase give an overall, rating. 1 2 3 4 5 6 
^ V Cgrpien t' . ^ ' . , ' * 

— , si : ^« ^ \ .^t 



Please* fold so:, that the portion ahove is inside - covered up. Thank you fbt your 
helo. » * ' • • ♦ * 



Fold here, ple^e, so that 'the portion belcw is outside ?^ staple 03> . tape "the edge, ' 
and .mail. ' ^ * ^ - 

T— ^ : ^— — — '■ ^ ~ — — 

^ 9 , Prepaid Postage 



X)ffice of. Bilingual Studied 
past Texfs State Lftiversity 
Con^refce, Texas^' 75428 
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